Silence net.OpErrors dealing with accept.

This code is borrowed from:
https://github.com/stretchr/graceful/blob/6e11439113e0d071338d6be3f10d7772817faf59/graceful.go#L52-L58