Received my replacement and did the same as the one it's replacing the power button dosent shut off. 
It's a nice frother but the first one started not turning off and now the replacement one just new out of the box did the same so sad