Don't Throw Away Your Confidence: Your Reward Is Closer Than You Realize