When purchasing goldfish, it is important to consider factors such as the breed, quality, and size. Additionally, shop around to compare prices, check for any signs of poor quality or health, and create a suitable environment in a cold water or heated aquarium.