MAINT: remove redundant isfinite checks