Yes! It will more time and asparagus might not be as crispy, but you can use your oven to cook asparagus from frozen. Bake for 15-20 minutes at 400°F or until the top ends become golden brown, tossing it halfway through.