Usually, the material that is being drilled is the reason for the drilled hole being larger than the drill size. Materials that wear out easily usually get bigger-sized holes as compared to hard materials. You can try using a drill bit smaller than the required size to avoid this problem.