Clear our attachment map upon a manload so we correctly reconfigure a
players new permissions.