Make your paver base out of crushed stone. Crushed gravel is a common choice. On top of that, a layer of bedding sand is often recommended.