Remove directories silently.