The primary considerations when selecting a site for a vegetable garden is the amount of sunlight, soil type and other factors. Vegetables grow best in well-drained, fertile soils. A well-drained soil is one through which water moves quickly. Vegetables grow poorly in heavy clay or poorly drained soils.