Add ARP fixer

This is yet another attempt to make it so we don't have 1RTT of overhead
in the tests on linux and windows (no clue why os x is so intelligent
about the whole process).