Remove server dir, shouldn't be tracked