only removing modes that are actually in the modes - probably doesnt matter, but enh.