Remove a solved question from cache