Patent ID: 11958201
Assignee: HONDA MOTOR CO., LTD.
Field: Handling (Mechanical engineering)
Classification: CPC B  G | IPC B  G

Claim 0:
1. A system for visuo-tactile object pose estimation, comprising:
a sensor module, implemented via a processor, configured to:
receive image data about an object in an environment;
receive depth data about the object in the environment; and
receive tactile data about the object in the environment;

a visual module, implemented via the processor, configured to generate a visual estimate of the object by processing a combined dataset of the image data and the depth data into a reconstructed fused image;
a tactile module, implemented via the processor, configured to separately generate a tactile estimate of the object by processing the tactile data; and
a pose module, implemented via the processor, configured to estimate a pose of the object based on the visual estimate and the tactile estimate, wherein
the visual module employs a first convolutional neural network (CNN) to process the combined dataset of the image data and the depth data.