Solved a problem removing layers from the map, as reported and solved by @vencax here:
https://github.com/tombatossals/angular-openlayers-directive/pull/31