This is a question with a lot of different answers. In some cases, you would put down gravel, but in other cases you might want to put down sand. It all depends on what you are trying to accomplish with the paver installation.