Add setters for providers and references to loader

Being able to set those is giving it enough flexibility to make a Symfony bundle for Alice.