A number of companies offer underwater tours in glass-bottomed boats or submersible craft, or you can rent snorkel or scuba gear to get a closer look yourself.
You can rent gear for diving or ride in boats with glass bottoms.