Fix a runtime warning

If one of the checks in the style refresh happened then the
refresh timer was destroyed with a return FALSE, but our source
id for that timer wasn't cleared. This fixes it.