Fix peer IP/Port binary parsing

This should *never* have taken so long.