Fix CMake abuse for assembly (.s) files

Based on comments from @ttsou and @balister