James Brown had at least 17 children, with birthdates ranging from 1802 for Lucinda to 1839 for Matilda. Of those who survived to adulthood, though, 11 were daughters and only 3 were sons. Most of his descendants also moved to Indiana during the 1870’s. So few of the Morgan county Brown families of later years are his descendants.

About 1865 four daughters of James and Emily moved with their husbands to Putnam Co., Indiana: Sesa with David Hall, Martha with Thomas J. Ferrand, Delilah with Sam Smedley, and Emily with William Pierce. Delilah and Sam returned to Kentucky by 1868, but the other three remained. It is possible, though, that the migration was spearheaded by Sam and Delilah, since there were already a group of Smedley families in Putnam Co. in the 1860 census, and it is not that common a surname.

1840 census of Morgan Co., Ky, lists on p. 25, line 13:
James Brown, 1 male 50-59, 1 female 40-49, 1 male 20-29, 1 female 20-29, 1 male 15-19, 1 female 15-19, 2 females 10-14, 1 female 5-9, 2 femails under 5.

Neighbors are David Bradshaw on the line above and Comodore Riddle on the line below.

1850 census of Morgan Co., Ky, records on page 105, as family #259:
James Brown, 67; Emily, 55; Cesa, 23; Delila, 17; Emily, 16; Matilda, 12. James and Emily born in Va, all others born in Kentucky.

The preceding two households were headed by Thomas Brown age 41 at #257 and John T. Brown age 55 at #258. I don’t know the relationship between Thomas Brown, John T. Brown and James Brown, but since they were next door neighbors (which often represents splitting the property of a parent) it is surely close. There may also be a relationship to Stephen Brown, age 40, who was listed at family #580.