Masterson lost her mother in the 1900 Galveston hurricane that she survived. Masterson had one brother and one sister, Wilmer D. Masterson and Lewis Fisher. Masterson also employed her nephews to mine the ore in her tungsten mine in Nederland. Both her great niece, Amanda Masterson, and her great-great nephew, Wilmer Dallam Masterson IV, attended UT.