If the referee notices you after 1 or 2 seconds, then he starts counting. Sometimes, they also give you warning to leave the key.