Aged 19, in 1846, James returned to America. He enlisted in Company G of the 2nd Ohio Infantry. He served under General Winfield Scott, in the Mexican–American War. After the war, the discovery of gold had become known, and he set out for California.