3 Civilian struggles, slavery, and politics. The next year, the Grants moved to land on Julia's father's farm, and built a home called 'Hardscrabble' on Grant's Farm. 'Hardscrabble', the farm home Grant built in Missouri for his family. 1891.