Over the last four decades, historians and social scientists have become increasingly interested in the way in which information about stature might be used to explore the impact of environmental factors on the physical growth and well-being of past populations. A particular problem encountered by many researchers is that height data is only available for selected populations, typically military recruits or those admitted to correctional institutions. Evidence from Australian military and prison records demonstrate how the two social groups, soldiers and prisoners, differed from each other and from the wider population in terms of age, birthplace, occupation, and stature. Different patterns of observable characteristics conceal additional differences in intergenerational experience. We trace male prisoners and soldiers born between 1870 and 1899 in Tasmania to their birth records and thence to the marriages of their parents. This allows us to contrast social and occupational change from father to son for both prisoners and soldiers. We conclude that evidence arising from these institutionalized populations can be used to estimate wider societal trends, although caution needs to be exercised.