Remove some unnecessary dirs in test specimens