Predicting Grasp Success with a Soft Sensing Skin and ShapeMemory Actuated Gripper Tactile sensors have been increasingly used to support rigid robot grippers in object grasping and manipulation. However, rigid grippers are often limited in their ability to handle compliant, delicate, or irregularly shaped objects. In recent years, grippers made from soft and flexible materials have become increasingly popular for certain manipulation tasks, e.g., grasping, due to their ability to conform to the object shape without the need for precise control. Although promising, such soft robot grippers currently suffer from the lack of available sensing modalities. In this work, we introduce a soft and stretchable sensing skin and incorporate it into the two fingers of a shapememory actuated soft gripper. The onboard sensing skin includes a 9axis inertial measurement unit (IMU) and five discrete pressure sensors per finger. We use this sensorized soft gripper to study grasp success and stability of over 2585 grasps with various objects using several machine learning methods. Our experiments show that LSTMs were the most accurate predictors of grasp success and stability, compared to SVMs, FFNNs, and STHMP. We also evaluated the effects on performance of each sensoru0027s data, and the success rates for individual objects. The results show that the accelerometer data of the IMUs has the largest contribution to the overall grasp prediction, which we attribute to its ability to detect precise movements of the gripper during grasping.

Experimental study on model vs. learningbased slip detection Vision and proprioception are traditional sources of information for robotic grasping, but they are insufficient to achieve a stable grasp without slippage or without applying an excessive force on the object. Tactile sensors can aid in this problem by providing spatial and temporal data on the contact between fingertips and object. In this work, tactile fingertip sensors are used to detect slippage through two separate methods: the first, using principles inspired by human tactile sensing, and the second, by using a convolutional neural network trained with suitably labeled test samples. To perform a fair comparison of the methods, two evaluations are performed using a test bench and a pickandplace robotic application. Results show promising use of the modelbased method to avoid translational slippage, as it was able to consistently keep objects from slipping without overloading the grasp. Limitations of both model and learningbased approaches are identified and discussed.