Generally, it's not a good idea to leave chillies on the plant too long as they may start to rot. We suggest that you harvest them soon after maturity.