Revert "Merge pull request #41 from 'milki/drop-privs-early'"

This reverts commit a1eb6b98d79b2085be15951776c49e2e88f3419d, reversing
changes made to 64644b774c376cf75a3e8715cb0623ecf656b99b.

We need root to bind to sockets...