[Master] Don't only build active arch in debug.

- Make this setting match all our other libraries!