Yes, you can omit the coffee. Personally, I think the coffee adds an extra layer of flavor that makes the creme brulee super delicious. The custard doesn't necessarily taste like coffee, it's more like a subtle touch.