Clue: Having made the side, a sportsman's idle very rarely (4,2,1,4,4)
Answer: ONCE IN A BLUE MOON
Explanation: Definition: very rarely
A charade of ONCE IN ('having made the side'), plus 'a' plus BLUE ('sportsman') plus MOON ('idle', verb).