Revert "Makefile: Add graphite optimizations to KBUILD"

This reverts commit 4fb75405ce1e2f9598723308c07f075adf2fe24a.

Signed-off-by: Zhao Wei Liew <zhaoweiliew@gmail.com>