If the bottle in still attached, you need to press and hold to turn off.  If the bottle is removed, it will off on its own.