The gentleman is speaking while the others are listening.
The man is not talking.
The man can't be speaking if he's not talking.
speaking not same as not talking.
The first sentence states the man is speaking, the other states he is not talking