[BUGFIX] Only remove extension dir on package removal