Use closeQuietly to avoid IOException on AlreadyClosed