Fix module removal

Module removal failed becaus we removed a directory that the package wanted to remove.