Do not epoll_wait() on the main socket: call accept4() directly
Revert 63bec24aeea (Store connection pointer in epoll_data_t)

For some reason, this is causing segfaults. Don't know why yet, need to
investigate further.