You can leave out the chili, but you might want to add some other sort of spice, like a touch of cinnamon and clove, for instance.