With the outbreak of the Civil War in 1861, Kimball again volunteered his services to Indiana and raised a company of infantry. Governor Oliver Morton named him the colonel of the 1,143-man 14th Indiana Infantry on June 7, 1861. He led his regiment in the campaigns in western Virginia, seeing his first combat at the Battle of Cheat Mountain in the autumn.