Revert "Little fix for external ColPack.cmake issue #1529"

This reverts commit 85b5000ed2ce4d0e04dbc89c4c4e2bd556e45671.

This broke the build