Fix math support building

When compiled as a module,
it wouldn't build at all.

Signed-off-by: Alec Ari <neotheuser@ymail.com>