Simulation-driven force-feedback controllers for haptic interaction

Validation level: 4. Other peer-reviewed paper publication

This technique couples a real-time interactive simulation of a physical model to a force-feedback controller, so that the sensations experienced by the user when interacting with the controller feels like physically interacting with the object that is simulated. In the most sophisticated versions of this technique, a single simulation is used to generate all the sensory feedback (auditory, visual and haptic)

Publications

Copy Bibtex Cadoz, C.; Luciani, A.; Florens, J-L. and Castagné, N. ACROE-ICA: artistic creation and computer interactive multisensory simulation force feedback gesture transducers. In Proceedings of the 2003 International Conference on New Interfaces for Musical Expression, pages 235-246, 2003.

Copy Bibtex Minsky, M. D. R. Computational haptics: The Sandpaper system for synthesizing texture for a force-feedback display. Ph.D. Thesis, Massachusetts Institute of Technology, 1978.

Copy Bibtex Leonard, J. and Villeneuve, J. Fast audio-haptic prototyping with mass-interaction physics. In Proceedings of the International Workshop on Haptic and Audio Interaction Design, 2019.

Copy Bibtex Salisbury, K.; Conti, F. and Barbagli, F. Haptic rendering: Introductory concepts. In IEEE Computer Graphics and Applications, 24 (2): 24-32, 2004.

Also featured in

Storyboard of Functions

Highlights:

physical simulation-driven force-feedback controllers are one of the most immersive ways of interacting with a computer, because it engages the human sensorimotor system in a way that emulates real-world physical interactions. It is especially useful in areas where expressive gestures are essential, such as music performances or tele-operation.

Limitations:

Real-time interactive physical simulations are computationally expensive, and as of 2019 they still require a heavy setup. Coupling these simulations to force-feedback controllers is particularly challenging, because generating haptic feedback in real time imposes strong constraints in terms of latency, sampling time, dynamic range and gain.