Link against math

Signed-off-by: Sean Qureshi <sean@tox.im>