libobs: Replace fmaxf with inline comparison.

This replaces the call to fmaxf with the equivalent inline comparison
which is a bit faster (at least on linux).