But , in the Panic of 1837 , the family suffered great losses .
The family 's fortunes were reversed during the Panic of 1837 .