build: remove unnecessary flag from CMAKE_FLAGS

We now append the deps install area into CMAKE_PREFIX_PATH.