Remove unneeded wheels directory