Fix the loader being always loaded bug

That was easier than I imagined...