A surgery system comprising: a camera and optics, wherein the optics are configured to image a field of view onto the camera, wherein the camera is configured to obtain two-dimensional camera images of the field of view and to generate camera image data representing the camera images; an OCT system configured to perform depth scans (A-scans) at selectable locations contained in the field of view and to generate depth scans data representing the depth scans; a data memory; a controller configured to: - receive the camera image data from the camera and the depth scans data from the OCT system and to process the camera images represented by the camera image data and the depth scans represented by the depth scans data; - identify a first portion of the at least one surgical tool in the camera images by object recognition; - determine first locations and second locations in the field of view based on at least one of the camera images and second depth scans, wherein the at least one surgical tool is located at the first locations and wherein the second locations are located aside of the at least one surgical tool; - trigger the OCT system to perform first depth scans at the determined first and second locations; - generate a first image representing at least one third portion of the at least one surgical tool; wherein the data memory stores geometry data of the at least one surgical tool; the object recognition for the identifying the first portion uses the geometry data of the at least one surgical tool; characterized in that the controller is further configured to: - identify a second portion of the at least one surgical tool in the first depth scans by object recognition using the geometry data of the at least one surgical tool; wherein the representation of the at least one third portion of the at least one surgical tool is based on the geometry data and wherein a position of the representation of the at least one third portion of the at least one surgical tool in the generated first image is based on the first depth scans. a camera and optics, wherein the optics are configured to image a field of view onto the camera, wherein the camera is configured to obtain two-dimensional camera images of the field of view and to generate camera image data representing the camera images; an OCT system configured to perform depth scans (A-scans) at selectable locations contained in the field of view and to generate depth scans data representing the depth scans; a data memory; a controller configured to: - receive the camera image data from the camera and the depth scans data from the OCT system and to process the camera images represented by the camera image data and the depth scans represented by the depth scans data; - identify a first portion of the at least one surgical tool in the camera images by object recognition; - determine first locations and second locations in the field of view based on at least one of the camera images and second depth scans, wherein the at least one surgical tool is located at the first locations and wherein the second locations are located aside of the at least one surgical tool; - trigger the OCT system to perform first depth scans at the determined first and second locations; - generate a first image representing at least one third portion of the at least one surgical tool; wherein - receive the camera image data from the camera and the depth scans data from the OCT system and to process the camera images represented by the camera image data and the depth scans represented by the depth scans data; - identify a first portion of the at least one surgical tool in the camera images by object recognition; - determine first locations and second locations in the field of view based on at least one of the camera images and second depth scans, wherein the at least one surgical tool is located at the first locations and wherein the second locations are located aside of the at least one surgical tool; - trigger the OCT system to perform first depth scans at the determined first and second locations; - generate a first image representing at least one third portion of the at least one surgical tool; the data memory stores geometry data of the at least one surgical tool; the object recognition for the identifying the first portion uses the geometry data of the at least one surgical tool; characterized in that the controller is further configured to: - identify a second portion of the at least one surgical tool in the first depth scans by object recognition using the geometry data of the at least one surgical tool; wherein the representation of the at least one third portion of the at least one surgical tool is based on the geometry data and wherein a position of the representation of the at least one third portion of the at least one surgical tool in the generated first image is based on the first depth scans. - identify a second portion of the at least one surgical tool in the first depth scans by object recognition using the geometry data of the at least one surgical tool;