Calculate smoother for either GCV or BIC