Yes, you can! Place the unpeeled bananas on a foil-lined baking sheet and bake them for 15 to 20 minutes at 300º F (150º C), or until they turn completely black. Remove from the oven and let them cool, then scoop out the flesh with a spoon and mash.