Rash guards and swim shirts are often used interchangeably. The main difference between a rash guard and a swim shirt is that a rash guard has a more tight fit to protect against abrasions from board sports like surfing.