The man is sweeping with a red broom.
The man is sweeping
"The man is sweeping" is a short version of "The man is sweeping with a red broom".
Sweeping with a broom is the same as sweeping.
Sweeping with a broom means he is sweeping.