Fix an further keepalive issue when responding with 204