Make sure the package removal happens before grub is run since
live-config does shitty things and dpkg-diverts update-initramfs