Sweeping up broken glass can be done, but it is important to take precautions. Carefully pick up the large pieces and dispose of them in a sturdy cardboard box. Sweep the remaining small pieces and use a wet rag to wipe the area thoroughly.