Revert "We can just use devtools-alarm which does this"

This reverts commit 30e98367e42c18f42e721456879641dd2b8a7cf4.