Solved this issue with the CSS height/width property:
https://github.com/tombatossals/angular-leaflet-directive/issues/145