Alfred Spencer was born in Spartanburg, , South Carolina in 1834. He is the son of Elias Spencer and Susan.
At some point the family moved to Benton County Alabama, where Alfred is found living at a neighbor’s house. It’s possible that it was a mistake made by the census taker, or he possibly was laboring for the neighbor at the time. In either regards, he is noted as Farming, as was his Brother Absalom B. Spencer, weather it was at home or a neighbors.