When Ferry and his men got to Gettysburg, it was clear that this battle would be unlike one they had previously seen. While waiting for support from Brigadier General George Armstrong Custer's men, Ferry led 200 unmounted cavalrymen into battle, famously saying, "Rally boys, Rally for the fence" shortly before he was shot in the head, dying instantly.