Moved the elwise CMake flag outside of the if statement