Lupines are toxic to most mammals. Thus, deer typically leave them alone-toxicity is, after all, an excellent defense mechanism. While deer may graze lupines in the fall as winter closes in, they typically avoid these plants unless there's little else available. Lupines are considered deer-resistant perennials.uality potting mix. And though growing outdoors is preferable, if you want to start with seeds, it is advisable to learn how to grow lavender indoors, too.