Fix frame confusion in Permutation Inverse and operator*

Fixes #149