If he replied., can we conclude that "He spoke back to me. "?
yes