Explicitly link libm

This is necessary on distributions without DSO, e.g. Fedora.

Signed-off-by: Fabian Deutsch <fabiand@fedoraproject.org>