Yes, you can use unsweetened cocoa powder for your frozen hot chocolate. This will give your drink a rich chocolate flavor. You can also use a combination of cocoa powder and chocolate syrup for an even more indulgent taste.