compressed_matrix: Fixed missing context switch for CSR-adaptive metainfo.

This has been a problem if one wanted to use compressed_matrix outside the
default memory domain.