Crushed stone or gravel works well as a retaining wall's backfill. On the first foot of the wall, start with stone or gravel; for the next two feet, use compacted earth.