You can harvest your banana peppers when they attain their mature size. They can be picked from the plant when they are yellow and wait so that they change their color into an orange or deep red.