No, you can't. Consuming fungal pathogens can cause allergic reactions. Generally, powdery mildew fungus is not dangerous for people, but in some cases, it can affect sensitive folks. Avoid eating affected leaves of rosemary plants. However, there is nothing drastic if you accidentally consume a few leaves that have a spot or two.