Yes you absolutely can. I only add a little because I do not want the graham flavor to over power the apple pie flavor. The amount in this recipe blends nicely with the other flavors. If you want graham crackers throughout, pour some ice cream into the pan (not all). Break up some crackers and sprinkle them on top. Sprinkle brown sugar as well. Pour the additional ice cream on top and repeat the graham cracker and brown sugar sprinkling.