A computer-implemented method of generating an overlay of medical video data and overlay data, the method comprising the steps: - acquiring, from a medical video modality, the medical video data comprising at least a first video frame and a second video frame of different points in time, t1 and t2, (step S1), - analysing the acquired medical video data comprising a comparison of the video data captured by the first and the second video frames (step S2); - providing initial overlay data (step S3), - generating modified overlay data by adapting the initial overlay data based on a result of the analysis of the medical video data (step S4), and - generating the overlay by generating a video output comprising at least medical video data originating from the medical video modality and comprising the generated modified overlay data (step S5); characterized in that the step of analysing the acquired medical video data (step S2) comprises determining a change in the medical video data over time by comparing the first and second video frame (301, 303); and in that the method further comprises the steps - acquiring, from the medical video modality, at least a third video frame of a third point in time t3, wherein the step of generating the modified overlay data (step S4) comprises: - using the determined change in the video data of the first and second video frames over time in a calculation of an extrapolation of the initial overlay data to the point in time t3 (step S4a), and wherein the generation of the overlay (step S5) comprises: - generating the video output comprising the third video frame and the initial overlay data that were extrapolated to the third point in time t3 (step S5a). - acquiring, from a medical video modality, the medical video data comprising at least a first video frame and a second video frame of different points in time, t1 and t2, (step S1), - analysing the acquired medical video data comprising a comparison of the video data captured by the first and the second video frames (step S2); - providing initial overlay data (step S3), - generating modified overlay data by adapting the initial overlay data based on a result of the analysis of the medical video data (step S4), and - generating the overlay by generating a video output comprising at least medical video data originating from the medical video modality and comprising the generated modified overlay data (step S5); characterized in that the step of analysing the acquired medical video data (step S2) comprises determining a change in the medical video data over time by comparing the first and second video frame (301, 303); and in that the method further comprises the steps - acquiring, from the medical video modality, at least a third video frame of a third point in time t3, - acquiring, from the medical video modality, at least a third video frame of a third point in time t3, wherein the step of generating the modified overlay data (step S4) comprises: - using the determined change in the video data of the first and second video frames over time in a calculation of an extrapolation of the initial overlay data to the point in time t3 (step S4a), and - using the determined change in the video data of the first and second video frames over time in a calculation of an extrapolation of the initial overlay data to the point in time t3 (step S4a), and wherein the generation of the overlay (step S5) comprises: - generating the video output comprising the third video frame and the initial overlay data that were extrapolated to the third point in time t3 (step S5a). - generating the video output comprising the third video frame and the initial overlay data that were extrapolated to the third point in time t3 (step S5a).