In most cases you can. Just make sure than any replacement batteries you buy are the same type, size, and have the same voltage as the original ones. The manufacturer will often indicate which batteries to use in the user guide, so pay attention to that as well.