1850 census of Bath Co., Ky, district 1, enumerated 25 Aug, lists on p. 121 as family #106:
Nathaniel Gregory, 27; Mahala, 25; John W., 7; Almaranda, 5; Mary A., 3; James R., 1. Nathaniel born in Tennessee, all others in Bath Co., Ky. (This enumerator listed counties, if in Kentucky.)

1860 census of Fleming Co., Ky, Elizaville, enumerated 10 Aug, lists on p. 112 as family #846/757:
Nat Grigsby, 37, farmer; Sarah, 26; David, 3; Jefferson, 2; James, 12; Sarah, 10; Enoch, 9. All listed as born in Kentucky.

James, Sarah and Enoch are listed after the two younger children because they are children of Nat’s first wife Mahala Templeman. Nathaniel and Mahala’s oldest son John is living with her brothers James and Henry. I do not know where their youngest son Edward was in 1860 (he was alive), nor what became of Almaranda and Mary A., who would have been respectively about 15 and 13 if still living.