[backend] also cache errors when reading the config

This helps a lot in the 'noremote' case.