Add fallback to old keys_per_user config value.