Stubbart was born Audrey Morford in Newman Grove, Nebraska. She was the second of five siblings, but with the death of her eldest sibling shortly after birth, Audrey became the oldest. She spent her early life in Newman Grove, Nebraska, close to an Indian reservation and could recount early experiences of encountering Sioux Indians in the decades following the Battle of Wounded Knee.