Most retaining walls, whether load-bearing or not, average between 3 and 4 feet in height. As a general rule, you do not want to build any sort of structure over 4 feet in height without including some type of structural support within.