A method for generating an output video stream in a video conference comprising: - Receiving a plurality of input video streams of the video conference - Receiving a series of observation events, the observation events belonging to a plurality of observable actions corresponding to actions made by participants of the video conference, - Providing a plurality of orchestration models, each model comprising ∘ A set of display states, each one associated with a predefined screen template, each screen template comprising a selected subset of the input video streams, ∘ Transition probabilities between the display states, ∘ Observation probabilities representing the conditional probabilities of the observable actions as a function of the display states, - Determining, for each of the orchestration models a probability of the series of observation events received, - Selecting an orchestration model corresponding to the highest probability - Using the selected orchestration model to perform the steps of: ∘ For each display state of the orchestration model, selecting the display state as a candidate display state, ∘ Determining a conditional probability of the candidate display state for the received series of observation events taking into account a sequence of display states including past display states and a current display state, ∘ Determining the candidate display state providing the highest conditional probability as an updated display state, ∘ Generating a video stream comprising one after the other a first sequence of images representing the screen template associated to the current display state and a second sequence of images representing the screen template associated to the updated display state. - Receiving a plurality of input video streams of the video conference - Receiving a series of observation events, the observation events belonging to a plurality of observable actions corresponding to actions made by participants of the video conference, - Providing a plurality of orchestration models, each model comprising ∘ A set of display states, each one associated with a predefined screen template, each screen template comprising a selected subset of the input video streams, ∘ Transition probabilities between the display states, ∘ Observation probabilities representing the conditional probabilities of the observable actions as a function of the display states, ∘ A set of display states, each one associated with a predefined screen template, each screen template comprising a selected subset of the input video streams, ∘ Transition probabilities between the display states, ∘ Observation probabilities representing the conditional probabilities of the observable actions as a function of the display states, - Determining, for each of the orchestration models a probability of the series of observation events received, - Selecting an orchestration model corresponding to the highest probability - Using the selected orchestration model to perform the steps of: ∘ For each display state of the orchestration model, selecting the display state as a candidate display state, ∘ Determining a conditional probability of the candidate display state for the received series of observation events taking into account a sequence of display states including past display states and a current display state, ∘ Determining the candidate display state providing the highest conditional probability as an updated display state, ∘ Generating a video stream comprising one after the other a first sequence of images representing the screen template associated to the current display state and a second sequence of images representing the screen template associated to the updated display state. ∘ For each display state of the orchestration model, selecting the display state as a candidate display state, ∘ Determining a conditional probability of the candidate display state for the received series of observation events taking into account a sequence of display states including past display states and a current display state, ∘ Determining the candidate display state providing the highest conditional probability as an updated display state, ∘ Generating a video stream comprising one after the other a first sequence of images representing the screen template associated to the current display state and a second sequence of images representing the screen template associated to the updated display state.