Re-add AppSignal configuration file.
Rescue from LoadError if AppSignal is missing.