Fixes #4110: Prevent a Rudder upgrade from breaking and old Rudder installation