libhb: Prefilter improvements for nlmeans.

Convert prefilter param into a proper enum.
Add option to blend source and filtered images for reduction in filter strength.
Refactor.