By the time of the Civil War in 1861, he had amassed 2,400 acres of land in Clayton County and 500 acres in Henry County. He also possessed 41 slaves which made him one of the largest land and slave owners of Clayton County. The Civil War came to his home on July 28, 1864 during the McCook-Stoneman Raid. Judge Dorsey was hidden for fear of capture by the Union soldiers. Then the next incursion to his property was on August 20, 1864 during the Kilpatrick Raid to Lovejoy Station. The fighting began at Lovejoy and spread across Judge Dorsey's land on into Henry County. Then the Union Soldiers returned when General Hardee of the CSA lost at Jonesboro on August 31-September 1, 1864. Then General Hood CSA also abandoned Atlanta to move into Lovejoy where he stayed for approximately two weeks. Then the last time the Union forces came to Lovejoy and Mr. Dorsey's land was when General Kilpatrick came through on the March to the Sea and drove General Iverson CSA to Griffin.