Don't remove idle connections until timeout.