Revert "Settings: Don't crash if we pause too quickly"

This reverts commit 58e8049e1ca6889cd4e9f0b00aec83d59f18afed.

Change-Id: Ibd07c77c10eb98e9c1d2dc09a8fb0841bdc1caa6