Fix travis maybe

Dropping the special case that used sudo under Travis to maybe fix the perms error when removing stuff