Your Jar of Wisdom: Learning How to Fill Your Jar