When cleaning up broken glass in the oven, first remove the large pieces carefully using gloves or tongs. Then use a vacuum cleaner to pick up the smaller glass fragments. Wipe the inside of the oven with a wet towel to ensure no tiny pieces remain.