The Hidden Memory of Objects