Revert "netfilter: Fix Build Error with -ffast-math"

This reverts commit fddb77077cfce23c47eb7ddc89f97bcf5edc0d01.