All agree that after the elder Cohen died, his widow, Judith Solomon Cohen (1766-1837), moved her six surviving children, all sons, from Richmond to Baltimore, where the family came to have sizeable influence. Jacob and at least one of his brothers served with distinction in the defense of the city during the War of 1812.