The Northern mill owner would not sell his own children into slavery