Manually write all source files into a cmake variable

This is better for example when one does not want to compile
a file.  Using a wildcard for that is just, bad.