Configure static arp inside interface_configure() since it removes all interface addresses and the static arps are removed together. It fixes #2939