A fight was called a card when it became an extended public event. You got to see the fights after they'd been arranged in order. The term “card” is short for “match”. In the early days, boxing matches were sometimes held on street corners.