Clean up the files/dirs that were necessary for the jar packaging