James Henry Taylor was mentioned in the 19 November 1835 will of his father, William Taylor, proved on 20 June 1836. [Essex County, Virginia, Will Book 24, pages 47–48.]

1850 U.S. Census, Essex County, Virginia
Page 74B, Dwelling 152, Family 152
Taylor, James, 31, male, farmer $300 real estate, born in Virginia, cannot read or write
Taylor, May, 23, female, born in Virginia, cannot read or write
Taylor, Emily, 11, female, born in Virginia
Taylor, Lucinda, 9, female, born in Virginia
Taylor, Drucilla, 2, female, born in Virginia
Berkley, Noah, 4, male, born in Virginia