Some people believe that lavender grown outdoors can grow in clay. Wild lavender, for example, grows in many areas and in all types of soil. Growing lavender inside is very different, though. Indoor lavender should be nurtured with adequate light and water and grown in soil with the proper pH.