Rename some files, also allow notifications to dismiss even if reporting to the new backend fails