Attempt to remove unecessary folders from the remote