Fix uninitialized woke_timeout and not clearing changed sets

Should fix problem where bogus recv calls need to be inserted