Oh yes. Habanero contains oils loaded with capsaicin which can irritate the skin, causing an unpleasant burning sensation. If you get the oil on your skin, wash it off with a good grease-cutting soap like Dawn and warm water.  Rubbing alcohol can also help dissolve the oil.  And, be careful when touching other parts of your body, as the oil can spread.