Simplify implementation of Latest

This does make for a potential memory leak with a sufficiently large set of builds, but I think that the trade off is probably worth it.