Remove messages from set after they are sent