Add module changing tracking.

This allows us to do the reversals without needing to look everything up
again