Start reading the serial port, see if that alleviates slowdown problems.