Cleanup the loaded configs on VM shutdown

I hope there are no whitespace problems this time