1850 census of Morgan Co., Ky, lists as family #580:
Stephen Brown, 40; Mary, 34; Jamima, 16; John, 14; Sarah, 13; Thomas, 9; Susan, 8; Nancy, 6; Elizabeth, 2. Stephen and Mary born in Virginia, all the children in Ky.

1860 census of Morgan Co., Ky, West Liberty, enumerated 16 July, lists on p. 80 as family #492/487:
Stephen Brown, 53, farmer; Mary, 47; Gemimah, 25; John, 23; Sarrah, 21; Susan, 19; Nancy, 16; Elizabeth, 11; Catharine, 9; Mathew, 7; Lydia M., 5. Stephen and Mary born in Virginia, all others in Ky. Note that Hiram is not listed. (The next household is that of their son Thomas and his wife Nancy.)

1870 census of Elliott Co., Ky, Moccasin precinct, lists as family #113:
Brown, Stephen, 64, Va; Mary, 57, Va; Nancy, 24, Va; Elizabeth, 22, Va; Hiram, 20, Va; Matthew, 17, Ky; Lydia, 15, Ky. (The place of birth is incorrect for Nancy, Elizabeth and Hiram.)

1880 census of Elliott Co., Ky, Martinsburg precinct, enumerated 10 June, lists on p. 15 as family #110:
Brown, Polly, 65, b. Va Va Va; Dolly, 27, dau, b. Ky Va Va; Lydia, 23, dau, b. Ky Va Va; Patrick, Ulysses G., 2, b. Ky Ky Ky.

I am making the assumption that Dolly is the same daughter listed as Catherine in 1860, although that might be incorrect.