Revert "Add linaro flags to Makefile and Kconfig"

This reverts commit 507f5338e53174ef3e30d655b8620a1c53d7d788.