Patent ID: 11931894
Assignee: SANCTUARY COGNITIVE SYSTEMS CORPORATION
Field: Handling (Mechanical engineering)
Classification: CPC B  G | IPC B  G

Claim 16:
17. A robot system comprising:
a robot body;
at least one sensor;
a robot controller including at least one processor and at least one non-transitory processor-readable storage medium, the at least one non-transitory processor-readable storage medium storing processor-executable instructions which when executed by the at least one processor cause the robot system to:
capture, by the at least one sensor, sensor data representing information about an environment of the robot body;
generate, by the at least one processor, a natural language (NL) description of the at least one aspect of the environment based on the sensor data;
provide an NL query to a large language model (LLM) module, the NL query including an NL description of at least one aspect of the environment, an NL description of a work objective, an NL description of an instruction set executable by the robot system, and an NL request for a task plan;
receive the task plan from the LLM module, the task plan expressed in NL; and
execute the task plan.