Set alarm only if it didn't yet