Jethro's Braindump

RSS 2020 Workshops: Visuotactile Sensors for Robust Manipulation - From Perception to Control



Soft Manipulation

Soft grippers enhance the robustness of gripping, particularly for complex object geometries

  • Compliance is a double-edged sword
  • We may need to sense what actually happened from “our” side of the compliance
  • We cannot assume post-grasp pose of objects
  • We may need to maintain a specific grasp pose or force
  • We may need to control through contact

Dense Geometry Tactile Sensors (DGT)

Benefits compared to RGB-D sensors:

  1. Agnostic to lighting conditions
  2. Agnostic to self-occlusion during manipulation
  3. Agnostic to hard-to-see objects


  1. Modelling difficulties

Modelling the Soft Membrane Dynamics

  • Use quasi-static approximation to model deformation in membrane
  • Knowing the deformation, it is possible to infer which part of the model causes the deformation (inverse model)

Tactile Image Sensors applicable to manipulation and inspection tasks

Links to this note