No, you don’t.  And it is better if you don’t (I know I will have a hard time counting all the cash - most prices are in thousands of kronas!!!!).  On all of our trips to Iceland, credit cards were super handy. You can also use your debit card with ease, no problems!