Yes, coffee filters can go in food waste in a compost heap. In addition to paper filters, you can also compost coffee grounds, tea bags, egg shells, and a number of other food waste items.