For this recipe, you’ll know when your swordfish steaks are done when the fish appears golden and pulls back easily from the skillet. In general, you can also measure with a meat thermometer–130 degrees F is medium, 135 degrees F is medium well, and 140 to 145 degrees F is well done.