CMake: Do options one directory above

This fixes linking when keychain was not desired.