No, it does not have to go all the way to the top, but there's certainly a minimal level. Furthermore, the lower the water, the slower the flow rate from the pump and the less filtration you would obtain.