To manage multiple API versions, services should clearly version their APIs and maintain backward compatibility for a period. This involves supporting multiple versions simultaneously and gradually phasing out older versions, ensuring smooth transitions and minimal disruption.