Only add the options when it's the top level cmakelists