Properly handle attaching clients and releasing buffers

Also, actually send the time in the frame callback, instead of just
sending 0. Now simple-shm actually works.