It's possible, but there is much about latex allergy that remains unknown. Keep in mind that cross-reactivity often occurs within a "family" of foods. A peach allergy, for example, may also mean you are allergic to apples, apricots, plums, or cherries. They're all within the same Rosacaean fruit family. You may want to try lower-risk fruits, such as strawberries, and let your healthcare provider or allergist know.