Not always. Even if you are not allergic to cow milk, you may be allergic to goat milk. However, this disorder is rare (20).