Found the culprit, was Application.DoEvents(); That was removed, although the UI might lag when being flooded with packets, be careful.