OSX build fixes for the Qt version

FFMpeg include and lib folders weren't set in the QMake.

Additionally the `floor` function can't be found in two of the *.cpp files.