Cats find the taste of milk good because of the high-fat content. Even if they have trouble digesting milk, they will still eat it. If you are feeding your cat a balanced meal, they don't require additional fats from milk. Contact a vet if your cat shows serious signs of illness after consuming milk.