There are lots of things you can fill cream puffs with. Here are my favorite ideas: You can fill your cream puffs with whipped cream, jam, Nutella, or ice cream.