In this recipe, yes you can. The heavy cream really adds a creamy texture and rich flavor so I recommend using it, but it's okay if you just use milk.