But experts say that the batteries you can buy at dollar stores are lower quality, Kiplinger reports. The carbon-zinc batteries that dollar stores typically sell don't last as long as the alkaline name brands.