Inverse matrix caching