remove EFGH matrix from inverse block