Yes, you can! You can use a lactose-free cream or a non-dairy milk like coconut or almond milk. Just keep in mind that it may alter the taste slightly.