Fix only building active arch in debug.
Merge pull request #119 from square/kve/fix-building-only-active-arch-for-debug

Fix only building active arch in debug.