Include only CPU operations in gen banded matrix