Bleach may appear to be a quick fix to poison oak or ivy. However, bleach removes the top layer(s) of your skin. Using it can irritate your skin and in the process weaken it so that the rash may become worse. Your skin may then become more susceptible to getting the rash in the future.