The man is sweeping with a red broom.
The man is sweeping dirt
Dirt is what is normally swept when one sweeps with a broom; that the man is sweeping is tautological.
Sweeping with a red broom is a method of sweeping dirt.
It can be inferred that sweeping with a broom involves sweeping up dirt.