Yes, you can bake homemade cheese sticks in the oven. Although they are not deep fried in oil, baking your sticks isn't all that healthy either; they are still big sticks of breaded cheese! In my opinion, you may as well fry them in oil for the best flavor.