The answer is no! Lavender needs proper sunlight for their growth and survival. So, if they get enough light even under oak trees, there is nothing to worry about. But, the more chances for them is to live in shades under oak trees which will ultimately not provide them scopes to survive.