Fix permanents never turning off usedactive