Yes, the land really does go all the way down. An island is mostly rock, so if it didn't go all the way down it would sink! The exception is ice-bergs, which do float, ice being less dense than water.