Revert "Allowed IP to be implicitly constructed from a u32 address."

This reverts commit cdbd8bb18c9f43f84d4a17ad27346b7b6439d6d8.