James Williams (1821) was born in Walton-on-Thames, Surrey, England. He was a shepherd. James married Elizabeth (born 1820 in Chertsey, Surrey). They had one child:
- George Williams (1865) born in Chertsey, Surrey, gardener
At the time of the 1881 census, James Williams and his family lived in Hitchin Ride Road, Chertsey, Surrey. Next door to the left lived William Garland, a fifty-three year old carpenter, with his children Thomas, a gardener and Hannah, a domestic servant. To the right lived Edward Knowles, a fifty-one year old far, labourer and his wife Martha.