By reading Grant, one discovers the reason why there was not bloody retribution after the war. The people on both sides considered themselves the same, a feeling strong in both armies, where older men had served together before the rebellion. In fact, the only bitterness remained with the deposed slaveowning class, who did consider themselves different, and sowed discord and evil that is still with us. He points out quite clearly the efforts of President Johnson first to crush his superiors in the Southern upper classes, and subsequently to pander to them for popularity. Lincoln's death was a disaster for reconstruction and the South.
Grant mentions the many regiments of volunteers from states that had seceded.
The whole of the mountain sections of Virginia, Kentucky, Tennessee and North Carolina were strong for the Union. The hill people were suppressed by the slaveowning elite, and were not eager to further their plans. He mentions finding loyalists in many places during his campaigns. Grant does not say much about the black population, but what he does is very enlightening. These men were very useful for jobs around the army, and also volunteered for service in uniform.