Yes, there are some fruits that are toxic to cats and should be avoided. Grapes and raisins, for example, can be harmful to cats' kidneys. Citrus fruits like oranges and lemons are also not recommended due to their high acidity. Always research and consult with your veterinarian before introducing new foods to your cat's diet.