As previously mentioned, there is no such thing as invertebrate fish. All fish have a backbone or vertebral column, which means they are vertebrates. This backbone provides structural support and protects the spinal cord, allowing fish to move and swim through the water with ease.