A system for performing an automated surgical procedure, comprising: a sensor (203,205) that provides information regarding a surgical field; a user interface configured to receive commands issued by a surgeon (200,300,400); a feedback device (209,309,212,312) configured to relay information to the surgeon (200,300); a surgical tool having an end portion used for performing a surgical task; a surgical robot (201,301,701) that is coupled to the surgical tool and that positions and orients the surgical tool; at least one near-infrared fluorescent marker configured to be deployed on at least one of a target tissue, surrounding tissues, and the surgical tool end portion; a track processing module (207,707) implemented by processing hardware and configured to: receive sensor data from the sensor (203,205), the received sensor data including data related to the at least one near-infrared fluorescent marker deployed on at least one of a target tissue, surrounding tissues, and the surgical tool end portion, identify positions in at least two of the target tissue, the surrounding tissues, and the surgical tool end portion based on the sensor data; and, generate tracking information by tracking the identified positions in the respective at least two of the target tissue, the surrounding tissues, and the surgical tool end portion, the tracking including identifying a location of the identified positions with respect to a reference position over time even when the identified positions move with respect to the reference position; and a control module implemented by the processing hardware and configured to process the surgical field information received from the sensor, the tracking information received from the track processing module (207,707), and the commands received from the user interface using an automation program (208,408), to generate commands for the surgical robot (201,301) based on the processing, and to send the commands to the surgical robot (201,301,701). a sensor (203,205) that provides information regarding a surgical field; a user interface configured to receive commands issued by a surgeon (200,300,400); a feedback device (209,309,212,312) configured to relay information to the surgeon (200,300); a surgical tool having an end portion used for performing a surgical task; a surgical robot (201,301,701) that is coupled to the surgical tool and that positions and orients the surgical tool; at least one near-infrared fluorescent marker configured to be deployed on at least one of a target tissue, surrounding tissues, and the surgical tool end portion; a track processing module (207,707) implemented by processing hardware and configured to: receive sensor data from the sensor (203,205), the received sensor data including data related to the at least one near-infrared fluorescent marker deployed on at least one of a target tissue, surrounding tissues, and the surgical tool end portion, identify positions in at least two of the target tissue, the surrounding tissues, and the surgical tool end portion based on the sensor data; and, generate tracking information by tracking the identified positions in the respective at least two of the target tissue, the surrounding tissues, and the surgical tool end portion, the tracking including identifying a location of the identified positions with respect to a reference position over time even when the identified positions move with respect to the reference position; and receive sensor data from the sensor (203,205), the received sensor data including data related to the at least one near-infrared fluorescent marker deployed on at least one of a target tissue, surrounding tissues, and the surgical tool end portion, identify positions in at least two of the target tissue, the surrounding tissues, and the surgical tool end portion based on the sensor data; and, generate tracking information by tracking the identified positions in the respective at least two of the target tissue, the surrounding tissues, and the surgical tool end portion, the tracking including identifying a location of the identified positions with respect to a reference position over time even when the identified positions move with respect to the reference position; and a control module implemented by the processing hardware and configured to process the surgical field information received from the sensor, the tracking information received from the track processing module (207,707), and the commands received from the user interface using an automation program (208,408), to generate commands for the surgical robot (201,301) based on the processing, and to send the commands to the surgical robot (201,301,701).