No, you do not need a website or blog to start affiliate marketing, but if you have a website or blog, then visitors will be connected to you in future also, through your website or blog.