LBA

The idea is to capture a user's action (a limb movement, speech sound, or orofacial movement) and display information about the muscles responsible for it by superimposing it on the user's image. This tool could be used to help medical students learn anatomy and to provide the general public with an interactive way to explore human anatomy in action.

The hypothesis underlying this study is that experiencing anatomical knowledge through one’s own body—or embodiment—could facilitate its acquisition. We aim to evaluate this hypothesis as well as the interactive techniques designed using real medical students. Another hypothesis is that the use of augmented reality could facilitate embodiment by establishing a closer link between models, knowledge, and reality. Advances in digital science, the development of web services and applications, and the widespread use of smartphones and tablets—both in general and specifically in the clinical setting—have led to a vast collection of accessible data and applications describing anatomy and other medical knowledge; however, to our knowledge, none of them bridge the gap between the user’s own body and this knowledge.

• Project Summary (in English)

Research teams

Six research teams are involved in the project:

• Computer-Assisted Medical and Surgical Procedures (GMCAO), TIMC-IMAG Laboratory
• Intuitive Modeling and Animation for Interactive Graphics & Narrative Environments (IMAGINE), LJK-INRIA Laboratory
• Automatic Signal for Monitoring, Diagnostics, and Biomechanics (SAIGA), GIPSA-Lab
• Talking Machines, Oral-Facial Gestures, Face-to-Face Interaction, Augmented Communication (MAGIC), GIPSA-Lab
• Human-Computer Interaction Engineering (IIHM), LIG Laboratory
• Heterogeneous Autonomous Distributed Data Services (HADAS), LIG Laboratory

Project Coordinators

• Jocelyne Troccaz (GMCAO, TIMC)
• Olivier Palombi (IMAGINE, LJK)
• Violaine Cahouet (SAIGA, GIPSA)
• Laurence Nigay (IIHM, LIG)

Project members

• Amore, Louis – 2015 intern (GMCAO, TIMC)
• Ballosso, Nicolas – 2014 intern (GMCAO, TIMC)
• Armelle Bauer – PhD student, 2013–2016 (GMCAO, TIMC – IMAGINE, LJK-INRIA)
• Carole-Anne Boissy – 2014 intern (IMAGINE, LJK-INRIA)
• Violaine Cahouet - Staff Member (SAIGA, GIPSA-Lab)
• Matthieu Chabanas - Staff Member (GMCAO, TIMC)
• Cherdieu, Mélaine - Postdoctoral Researcher (MAGIC, GIPSA-Lab)
• Dicko, Ali-Hamadi - (IMAGINE, LJK-INRIA)
• Faure, François - permanent staff member (AnatoScope - IMAGINE, LJK-INRIA)
• Hueber, Thomas - (MAGIC, GIPSA-Lab)
• Fabrice Jouanot - Full-time (HADAS, LIG)
• Laurence Nigay - Staff Member (IIHM, LIG)
• Florent Paclet - Postdoctoral Researcher (SAIGA, GIPSA-Lab)
• Olivier Palombi - Staff Member (IMAGINE, LJK-INRIA)
• Payan, Yohan - full-time (GMCAO, TIMC)
• Sébastien Pelurson – Postdoctoral Researcher (IIHM, LIG)
• Perrier, Pascal - Staff Member (MAGIC, GIPSA-Lab)
• Emmanuel Promayon - Staff Member (GMCAO, TIMC)
• Valentin Prulière – 2015 intern (IIHM, LIG)
• Raj Neog, Debanga – 2016 intern (IMAGINE, INRIA)
• Rifat, Uzma – 2014 intern (IIHM, LIG)
• Amélie Rochet-Capellan - Staff Member (MAGIC, GIPSA-Lab)
• Jocelyne Troccaz - Staff Member (GMCAO, TIMC)
• Ulliana, Federico - Postdoctoral Researcher (HADAS, LIG)
• Etienne Viallet – 2015 intern (IIHM, LIG)
• Vincent, Thomas – Ph.D. candidate (IIHM, LIG)

Collaborations

• the Grenoble School of Medicine
• LADAF
• AnatoScope

News

Presentations

• June 16–17, 2014: Presentation of the LBA at the PERSYVAL Scientific Conference

External seminars

• May 3, 2016: LBA Seminar – Sandra BERNEY – Learning Complex Information from Animations: The Effects of Spatial Abilities and Design Factors.
• April 24, 2014: LBA Seminar – Nady El Hoyek – Visuospatial Skills and Anatomy Learning: The Role of 3D Animations

Meetings

• November 10, 2016: Armelle Bauer’s thesis defense – User-specific anatomical modeling and real-time animation. Application to anatomy education.
• December 11, 2015: Presentation - Mélaine Cherdieu - Embodiment and sensorimotor exploration to improve the effectiveness of learning functional anatomy.
• January 8, 2015: Meeting
• June 3, 2014: Meeting
• May 28, 2014: Meeting
• February 6, 2014: Meeting
• October 8, 2013: Kickoff meeting

Publications

Postdoc - Mélaine Cherdieu (2015–2016)

Can arm-hand gestures help in learning the anatomical structures of the arm and hand?

Ph.D. thesis - Armelle Bauer (2013–2016)

User-specific anatomical modeling and real-time animation. Application to anatomy education

Project Publications

• Mélaine Cherdieu, Olivier Palombi, Pascal Perrier, Jocelyne Troccaz, Amélie Rochet-Capellan. Make gestures to learn: the case of anatomy learning. Work in progress
• Eric Tatulli, Thomas Hueber. Feature Extraction using Multimodal Convolutional Neural Networks for Visual Speech Recognition. Proceedings of ICASSP'2017, March 2017, New Orleans, USA. 2017. paper
• Mélaine Cherdieu, Olivier Palombi, Pascal Perrier, Jocelyne Troccaz, Amélie Rochet-Capellan. Winter, The Fifth Winter School on Speech Perception and Production, Learning and Memory, January 2017, Chorin, Germany. 2017.
• Armelle Bauer, Ali-Hamadi Dicko, François Faure, Olivier Palombi, Laurence Nigay, Amélie Rochet-Capellan, Jocelyne Troccaz. Moving Your Body to Learn Anatomy. “HCI for Training” Workshop – 2016 Francophone HCI Conference, October 2016, Fribourg, Switzerland. 2016. slides
• Armelle Bauer, Ali-Hamadi Dicko, François Faure, Olivier Palombi, Jocelyne Troccaz. Anatomical Mirroring: Real-time User-specific Anatomy in Motion Using a Commodity Depth Camera. Motion in Games (MIG'16), October 2016, San Francisco, United States. 2016. slides, hal-01366704, video
• Mélaine Cherdieu, Amélie Rochet-Capellan, Pascal Perrier, Jocelyne Troccaz, Olivier Palombi. Move to learn: Can gestures help anatomy learning?. Spatial Cognition 2016, August 2–5, 2016, Philadelphia, USA. 2016.
• Armelle Bauer, Jocelyne Troccaz, François Faure, Olivier Palombi. Virtual Anatomy for Learning. Association of Morphologists (98th Annual Congress) – Presentation (Best Presentation Award), March 2016, Toulouse, France. 2016. Slides
• Armelle Bauer, Ali-Hamadi Dicko, Olivier Palombi, François Faure, Jocelyne Troccaz. Living Book of Anatomy (LBA) Project: See Your Insides in Motion! SIGGRAPH Asia 2015 – Emerging Technologies, November 2015, Kobe, Japan. 2015. Slides, hal-01186518, video
• Armelle Bauer, Florent Paclet, Violaine Cahouet, Ali-Hamadi Dicko, Olivier Palombi, François Faure, Jocelyne Troccaz. Interactive Visualization of Muscle Activity During Limb Movements: Towards Enhanced Anatomy Learning. Eurographics Workshop VCBM, September 2014, Vienna, Austria. 2014. slides, hal-01057027, video
• Armelle Bauer, Federico Ulliana, Ali-Hamadi Dicko, Benjamin Gilles, Olivier Palombi, François Faure. MyCorporisFabrica: Making Anatomy Easy. SIGGRAPH – Studio Talks, August 2014, Vancouver, Canada. 2014. slides, hal-00987439, video
• Armelle Bauer, Jocelyne Troccaz, Olivier Palombi, François Faure. The Living Book of Anatomy “Model and user mapping”. Persyval-lab Scientific Days - Poster June 2014, Grenoble, France. 2014. poster

Other results

An@tomy2020

The feasibility demonstrated in the LBA led to the launch of a new project, An@tomy2020, funded by the ANR for 42 months, beginning in the fall of 2016. An@tomy2020 is coordinated by Jocelyne Troccaz of the TIMC-IMAG laboratory atUniversité Grenoble Alpes. The other partners are Anatoscope (François Faure), a spin-off of the university and INRIA, the LIG laboratory (Laurence Nigay), Université Grenoble Alpes, the LJK laboratory (Olivier Palombi), Université Grenoble Alpes, the Gipsa laboratory (Amélie Rochet-Capellan), CNRS, and the LIBM laboratory (Nady El Hoyek), Université Lyon 1.