Mixing the cocoa powder with the milk to a smooth paste is a very important step in the recipe. If you skip this step, the hot chocolate will definitely have lumps. If you've done this and are still finding lumps, whisking will hopefully help. If it still isn't smooth enough, straining through a sieve will do the job.