There are various retaining walls kinds, each with a unique construction technique. You could discover that mortar is your best option for holding the stones in place for retaining walls made of stacked stone or natural stone. The wall blocks for a retaining wall have lips that fit into the course below, securing them in place.