I wouldn't. The liners make it much easier to pop the cooked muffins out.