Clue: Everyone in the group heading off — he wasn't free (5)
Answer: HELOT
Explanation: Definition: he wasn't free
[t]HE LOT ('the group') minus the first letter ('heading off')).