Williams wrote and published his experiences in Mercer County and in the events that led up to the Civil War in Kansas in a memoir published in 1908 titled "With the Border Ruffians", which is the earliest narrative of life in Montcalm's Bluestone Valley.