Handle remove of jars as well