Most Radio Shack and similar electronics stores accept lithium and NiCad batteries for recycling.
Some offices take alkaline batteries.
You can give them to most stores that mail packages. Cans and Glass are put into furnances and melted - so the labels are burned off. Plastic is melted - but does not get hot enough to burn off the labels. Now, lots of plastic containers have plastic labels rather than paper labels - the plastic labels recycle along with the container. So you should wash paper labels off of plastic but you don't need to wash any labels off of cans or glass.