Yes, you most certainly can. Just preheat the oven to 350ºF, place the jalapeños on a baking sheet and bake for 15 minutes until golden brown.