Yes, you do. It not only helps to get rid of that milky taste and gives a smooth looking texture, it also helps the butter to last longer without spoiling.