Original: Colfax, California boasts a bronze statue of Colfax, it stands next to the tracks at the AMTRAK station.
Simplified: The now ghost town of Colfax, Colorado was named after him. Colfax County, New Mexico is named after the Speaker as well.