Fix attaching with UNIX sockets

UNIX sockets can't have attributes set on them.