You can absolutely leave out the bacon. Just use a tiny bit more chicken, or add in some mushrooms. If you use mushrooms I would quickly fry them off separately just to cook out some of the moisture.