It depends on the kind of spice you're looking for, quite honestly.
If you want a milder chilli, and a longer harvest, Chris suggests you 'harvest chillies when they’re green to encourage further cropping'.
'When they’re left to ripen on the plant, new flowers won’t be produced,' he adds.