Revert "net: netfilter: Force no unsafe math optimizations"

This reverts commit c2ffb67efe867260829ca08aca883c8ccbf4ce42.

Signed-off-by: Zhao Wei Liew <zhaoweiliew@gmail.com>