Miller's home was destroyed, along with most of Linn City, in a flood of the Willamette River on December 1, 1861. Miller's home was thought to be the safest structure in the town, and other people sheltered there. But as the water rose, it became obvious they would have to evacuate the structure, which was done just before the building was swept away.