Makefile: Compile with misc optimizations in most places

Signed-off-by: Zhao Wei Liew <zhaoweiliew@gmail.com>