There are no hard and fast rules (and no limits imposed by the taxation law governing ESOPs). We have implemented plans with as little as 10% of shares held by the ESOP and somewhere the ESOP is gradually buying the whole business (100%).
The amount you sell needs to be enough to be of value to employees and provide a reasonable stake in the business.