EMI: Remove doublefreeing of materials.

I think there are cases where things are not all freed, but something else
is going wrong causing issues here.