Add removal of files installed by the package

Some files are placed by the package which we don't use.
Lets remove them