Historically, we've returned `NaN` here. That said, I think you're right to use `Inf` instead. We should make sure the other distributions are consistent.