Before backfilling a swimming pool with dirt, you need to drain and break down the pool properly first. You then need to use compacted, specialized dirt to prevent issues like sinkholes or flooding.