There was a moment when you could not have been all together, or it would not have been necessary to call to Monsieur Lawrence to come and join you on the balcony."
If you could have been all together, there would have been no need to call Monsieur Lawrence.