During the Battle of Totopotomoy Creek (the house stands 0.4 miles away from Totopotomoy Creek ) on May 30, 1864, the house suffered severe damage from artillery fire. Union signalmen climbed atop the house to convey messages to their troops. Confederate cannoneers tried to shoot them down, striking the building 51 times, but the signalmen survived. The scars of the damage remain today, but the Sheltons, who had sheltered in the basement during the battle, continued to reside in the house.