It goes in the upper chamber, so that the smoke diffuses into a pool of water after traveling down through the built-in downstem. It's not really an issue if there's a little bit of water in the bottom part but it's not necessary!