Some online family trees list Harvey as a son of James Wallace Brown and Nancy Ann Auxier, but I know of no source for that attribution, so I am marking it as a tentative link.

Do not confuse her with Hulda K. Martin (1834-1854) who married John Armstrong Cassity

The Cassidy/Cassity Family Association web site lists Hulda’s parents as Thomas? Cassity and Mary Smedley?, with Michael? as Thomas’s father, but since the names are listed there as tentative and there are no links to any of the rest of the Cassity family tree, it doesn’t seem worth putting them in here.

Morgan Co. marriage register A records marriage on 22 Feb 1844 of Harvey Brown and Huddah Cassity by Daniel Dillon. (Also married on the same day by the same minister were Jefferson Cassity and Amanda Smith.)

1850 census of Morgan Co., Ky, records as family #32 (between Uriah Cottle and Amanda Brown):
Harvey Brown, 31; Huldah, 27; James, 4; William, 3; John, 4/12. All born in Kentucky.

See notes for Huldah’s second marriage for the 1860 census reading.