After being released in a prisoner exchange, he was promoted to the rank of brigadier general and sent to West Tennessee, where he assumed command of a mixed brigade of Mississippi and Tennessee soldiers. Winning distinction at the Battle of Coffeeville, Baldwin would later participate in the battles of Port Gibson and Champion's Hill during the Vicksburg Campaign. Baldwin was captured when Vicksburg fell. After being exchanged he was assigned to the District of Mobile. There he was killed in an accident when a broken stirrup caused him to fall off his horse, near the Dog River in Alabama.