Delete cache and settings on upgrade (while we're running alpha tests)