Don't join until we fix the timeout stuff on select()