The biggest factor for me is how they smell. Scallops should have a fresh ocean scent and be opaque. If they smell overly fishy or pungent, they will probably taste that way too. Look for scallops that are all about the same size so they cook evenly. You want the larger sea scallops rather than small bay scallops.