Another way to say "All vertebrates have spines." is "A vertebrate has a backbone."