Obscure as fuck IRQ fix

Might have fixed a very very very obscure IRQ bug. Specifically an IRQ
during a CPU bubble might be cancelled leading to the IRQ to be ignored
until the next branch routine.

There were a few "unnecessary" checks that shouldn't have existed, but
apparently were in place to partially "correct" the issue from long
ago. This commit is the proper fix.