Fix a bug where -O2 overwrote previous -fno-ignore-asserts