[MRG] FIX scale - Raise ValueError when input contains non finite

@larsmans Fixes #3782
@amueller please let me know if this is enough? ( Are there any more cases of non finiteness that needs to be tested? )