Revert "Makefile: Optimize with -Ofast and some others"

This reverts commit 23b85f91a9778dfac5278df58426cd2832d59709.