Remove thread-local connection for conn dict when closing it.