So, to answer the question, leave your feeders up until you are sure there no orioles left passing through the area. If you have not seen an oriole in a week or two, chances are they have left for the year. Keeping your feeders on standby and a container of BirdBerry Jelly handy is always good practice - just in case!