A system for performing surface processing on a three dimensional object in a work environment comprising: a stationary or mobile base; one or more robotic manipulators, each of said robotic manipulators including an end effector having a surface processing tool, a ranging sensor and one or more surface property sensors attached thereto, said one or more robotic manipulators being mounted on said stationary or mobile base; a computer comprising software for controlling said one or more robotic manipulators, said software comprising: a surface property analyzer, for processing surface properties sensor data before and after the processing point of said surface processing tool to classify the current state of said surface; a surface model for storage of the geometry of said surface and said current state of said surface, wherein the software is adapted to generate the surface model by refining a three dimensional base model of said three dimensional object by causing a surface scan of said three dimensional object and augmenting said base model with range data and surface property data obtained from said scan; a surface process planner for planning a sequence of processing actions to be carried out by said processing tool based on an observed state of said surface stored in said surface model, wherein the surface process planner is adapted to create a temporal sequence of states of said one or more robotic manipulators comprising a set of positions and poses; a surface process modulator for modifying said planned sequence of processing actions based on real-time feedback from said ranging sensor and said one or more surface property sensors; and a surface coverage planner, for planning movements and poses of said one or more robotic manipulators to maximize coverage of said surface. a stationary or mobile base; one or more robotic manipulators, each of said robotic manipulators including an end effector having a surface processing tool, a ranging sensor and one or more surface property sensors attached thereto, said one or more robotic manipulators being mounted on said stationary or mobile base; a computer comprising software for controlling said one or more robotic manipulators, said software comprising: a surface property analyzer, for processing surface properties sensor data before and after the processing point of said surface processing tool to classify the current state of said surface; a surface model for storage of the geometry of said surface and said current state of said surface, wherein the software is adapted to generate the surface model by refining a three dimensional base model of said three dimensional object by causing a surface scan of said three dimensional object and augmenting said base model with range data and surface property data obtained from said scan; a surface process planner for planning a sequence of processing actions to be carried out by said processing tool based on an observed state of said surface stored in said surface model, wherein the surface process planner is adapted to create a temporal sequence of states of said one or more robotic manipulators comprising a set of positions and poses; a surface process modulator for modifying said planned sequence of processing actions based on real-time feedback from said ranging sensor and said one or more surface property sensors; and a surface coverage planner, for planning movements and poses of said one or more robotic manipulators to maximize coverage of said surface. a surface property analyzer, for processing surface properties sensor data before and after the processing point of said surface processing tool to classify the current state of said surface; a surface model for storage of the geometry of said surface and said current state of said surface, wherein the software is adapted to generate the surface model by refining a three dimensional base model of said three dimensional object by causing a surface scan of said three dimensional object and augmenting said base model with range data and surface property data obtained from said scan; a surface process planner for planning a sequence of processing actions to be carried out by said processing tool based on an observed state of said surface stored in said surface model, wherein the surface process planner is adapted to create a temporal sequence of states of said one or more robotic manipulators comprising a set of positions and poses; a surface process modulator for modifying said planned sequence of processing actions based on real-time feedback from said ranging sensor and said one or more surface property sensors; and a surface coverage planner, for planning movements and poses of said one or more robotic manipulators to maximize coverage of said surface.