Remove everything from openjdk before provisioning