Issue #2373395 by djdevin: Add a "builds on last attempt" functionality