Fix debouncing on Phantom.

I think this should fix the the debouncing on the Phantom.

I was not able to consistently reproduce the sticking keys previously. So I have not been able to verify this fix 100%.