When Union forces captured New Orleans in 1862, the Confederate forces evacuated Fort Pike. The Union reestablished control of the installation, using it as a base for raids. The fort also became a site for training of United States Colored Troops, established in 1864. These soldiers in the South included mostly former slaves.