Yes, but it's not ideal. You can pour concrete directly on dirt, as long as the dirt is perfectly stable, drains well, and does not contain organic materials that will decay. Because dirt doesn't always have these qualities in combination, gravel and sand are usually a better base for concrete than dirt.