Delete directory with package installed via composer/installers

I've noticed composer/installers does not remove package physically when I removed dependency on the package. It could lead (at least at me) to problems with other dependencies.