When creating your round-robin assignment rule, don't forget to add a condition that makes sure the assignment action is not triggered if the conversation is already assigned: