A full-body teleoperation system for human-in-the-loop control of a humanoid robot.


HERMES Robot

The purpose of this Human-Machine Interface (HMI) is to create a new media to aid the task of bilateral feedback during full-body teleoperation of humanoid robots. It explores human’s primitive motor skills to enhance the dynamic behavior of the slave platform to a performance level comparable to humans.The HERMES humanoid robot system is designed for studying whole-body human-in-the-loop control with balance feedback. Inspired by the innate physical control capabilities of humans as well as the capacity for creative learning, we explore the use of the full-body of the human operator as the controller for a humanoid robot. The state of balance of the robot is displayed as sensory feedback to the human operator applied as force to the waist in order to stimulate corrective teleoperated control actions.The machine is much stronger than humans and can be sent to dangerous locations for search and rescue operations. If its pilot can't follow it closely such as places that are too toxic or dangerous for people the operator has to wear a heads-up display to see what it's seeing. The developers plan to give it "some level of autonomous control" in the future, perhaps to make sure it can still function in case its connection with the pilot gets severed.<img data-fr-image-pasted="true" src="https://projects.wevolver.com/wevolver.staff/HERMES%20Robot/readfile?path=Images/hip.png&amp;permissions=eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJleHAiOjE2MDI5NjcxMzYsImlzcyI6Indldm9sdmVyIiwidXNlciI6IjVjZWNiZjA4YjQyY2JhMTM2ZWMyZWM3ZiIsInByb2plY3QiOiJIRVJNRVMgUm9ib3QiLCJwZXJtaXNzaW9ucyI6IlsncmVhZCcsICd3cml0ZScsICdjcmVhdGUnXSJ9.TedUn_29QB3mqg_Ww0H5BQ3fh45SU0kn5VSO4eMEn_BmQfynYLmNNoRndnvpTO4tglVWBKhTNaBCn0F5lalwR2IzxftHvj6kuK9960hzc-eNXvnMiHH64Ygz_8vPz_1PYZffaJKDpNsOcDeCA4dWLGuI_fhrizLYDdOOthGvYc_wgNFMTCZ3L3u-Q9zww3azNwRp6s3nwqpuS9LoP43jLM5yy-sHMl75tOb05ntUA-hzP-Fp6tc7gKXezL3RPI_wcGv6EKpz8_CC1YnpfsbyPklh0JLMR91vVvyVJc8X_eSGnPLUWE1lnnKXkphy_h0_V5vjf2UmPJgzzog4uqn81vzGNpKo6gig93r6aL9QSiO_cQFv0Yvuw6c_9uVQndzlG8dvlx5XmVfLiQHLYlm9W78XmYk6ONOHiXixTzqgnWf2FgHzhAdc-ny4S2tPzMkRP-7K9MG4C1HHS8kzv6I6-lojBvJxT_tMNsgjTeiLsjRsSUWREJznEPBZJQd1qYq_kWNf056SrsZed_FQFgC3giTx7_19d8lN9_NT739OVLGgz5VRT0DlQ_H6H7ztOeLBhh8GjQC04mJwAVHFz7-6XsUDBJRadwr0RCERbWLkL1-diQ7FiWa-2gm6cFTkedSDeiHuyg3wDJjwV6D6E8qMU5s0h0Z4EQRyLMmRfljZ7Ww" alt="" class="fr-fic fr-dii">A sensor suit worn by the human operator is linked to Hermes, which allows the robot to balance itself more effectively. The sensor suit also allows the human to feel the force feedback the robot experiences, effectively making the Hermes a real-life avatar for its human operator.<img data-fr-image-pasted="true" src="https://projects.wevolver.com/wevolver.staff/HERMES%20Robot/readfile?path=Images/hip2.png&amp;permissions=eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJleHAiOjE2MDI5NjcxMzYsImlzcyI6Indldm9sdmVyIiwidXNlciI6IjVjZWNiZjA4YjQyY2JhMTM2ZWMyZWM3ZiIsInByb2plY3QiOiJIRVJNRVMgUm9ib3QiLCJwZXJtaXNzaW9ucyI6IlsncmVhZCcsICd3cml0ZScsICdjcmVhdGUnXSJ9.TedUn_29QB3mqg_Ww0H5BQ3fh45SU0kn5VSO4eMEn_BmQfynYLmNNoRndnvpTO4tglVWBKhTNaBCn0F5lalwR2IzxftHvj6kuK9960hzc-eNXvnMiHH64Ygz_8vPz_1PYZffaJKDpNsOcDeCA4dWLGuI_fhrizLYDdOOthGvYc_wgNFMTCZ3L3u-Q9zww3azNwRp6s3nwqpuS9LoP43jLM5yy-sHMl75tOb05ntUA-hzP-Fp6tc7gKXezL3RPI_wcGv6EKpz8_CC1YnpfsbyPklh0JLMR91vVvyVJc8X_eSGnPLUWE1lnnKXkphy_h0_V5vjf2UmPJgzzog4uqn81vzGNpKo6gig93r6aL9QSiO_cQFv0Yvuw6c_9uVQndzlG8dvlx5XmVfLiQHLYlm9W78XmYk6ONOHiXixTzqgnWf2FgHzhAdc-ny4S2tPzMkRP-7K9MG4C1HHS8kzv6I6-lojBvJxT_tMNsgjTeiLsjRsSUWREJznEPBZJQd1qYq_kWNf056SrsZed_FQFgC3giTx7_19d8lN9_NT739OVLGgz5VRT0DlQ_H6H7ztOeLBhh8GjQC04mJwAVHFz7-6XsUDBJRadwr0RCERbWLkL1-diQ7FiWa-2gm6cFTkedSDeiHuyg3wDJjwV6D6E8qMU5s0h0Z4EQRyLMmRfljZ7Ww" alt="" class="fr-fic fr-dii">The real-time force feedback dynamic is demoed in the video (top of page) and the sensations felt by the human operator appear to be instantaneous and comparable to the force experienced by the robot.Controllers in the human pilot’s hands control the robot’s hands, and a camera on the head of the robot feeds video straight back to the pilot, so that person can see through the robot’s head as though the pilot was there.<img data-fr-image-pasted="true" src="https://projects.wevolver.com/wevolver.staff/HERMES%20Robot/readfile?path=Images/php87rHR2_55cc27e2749a0.jpg&amp;permissions=eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJleHAiOjE2MDI5NjcxMzYsImlzcyI6Indldm9sdmVyIiwidXNlciI6IjVjZWNiZjA4YjQyY2JhMTM2ZWMyZWM3ZiIsInByb2plY3QiOiJIRVJNRVMgUm9ib3QiLCJwZXJtaXNzaW9ucyI6IlsncmVhZCcsICd3cml0ZScsICdjcmVhdGUnXSJ9.TedUn_29QB3mqg_Ww0H5BQ3fh45SU0kn5VSO4eMEn_BmQfynYLmNNoRndnvpTO4tglVWBKhTNaBCn0F5lalwR2IzxftHvj6kuK9960hzc-eNXvnMiHH64Ygz_8vPz_1PYZffaJKDpNsOcDeCA4dWLGuI_fhrizLYDdOOthGvYc_wgNFMTCZ3L3u-Q9zww3azNwRp6s3nwqpuS9LoP43jLM5yy-sHMl75tOb05ntUA-hzP-Fp6tc7gKXezL3RPI_wcGv6EKpz8_CC1YnpfsbyPklh0JLMR91vVvyVJc8X_eSGnPLUWE1lnnKXkphy_h0_V5vjf2UmPJgzzog4uqn81vzGNpKo6gig93r6aL9QSiO_cQFv0Yvuw6c_9uVQndzlG8dvlx5XmVfLiQHLYlm9W78XmYk6ONOHiXixTzqgnWf2FgHzhAdc-ny4S2tPzMkRP-7K9MG4C1HHS8kzv6I6-lojBvJxT_tMNsgjTeiLsjRsSUWREJznEPBZJQd1qYq_kWNf056SrsZed_FQFgC3giTx7_19d8lN9_NT739OVLGgz5VRT0DlQ_H6H7ztOeLBhh8GjQC04mJwAVHFz7-6XsUDBJRadwr0RCERbWLkL1-diQ7FiWa-2gm6cFTkedSDeiHuyg3wDJjwV6D6E8qMU5s0h0Z4EQRyLMmRfljZ7Ww" alt="" class="fr-fic fr-dii">The hands of Hermes, three-fingered claws that can pick up power tools, crush a soda can or even pour out a coffee. Using joysticks rigged up to the main exoskeleton, the human operator is able to pick up objects and interact with the surroundings with more precision than a robot of this type would usually have.<h3>Specifications</h3><ul><li>High-power motors for large tasks</li><li>Human-like Dimensions</li><li>Light-weight limbs for quick moments</li><li>Hands capable of grasping and utilizing tools</li><li>Haptic suit for realtime feedback</li></ul>

Presents the legged robot model and the identification of the appropriate linear model for the human CoM dynamics. Shows the overall system interactions and simulation results, and experiments conducted with the real human-size robot. Lastly, it shows some conclusions and gives a brief overview of t

Robot-human balance state transfer during full-body humanoid teleoperation using Divergent Component of Motion dynamics

Introduces the balance feedback interface (BFI) that addresses the problem of bilateral feedback for teleoperation of humanoid robots. The haptic feedback interface that informs to the human the robot’s dynamic behavior is presented in Section II. Then covers a brief introduction to the lower body o

A Balance Feedback Human Machine Interface for Humanoid Teleoperation in Dynamic Tasks

Addresses the system design principles and shows the major design components of the humanoid robot. Presents results from preliminary strategies for balancing with the human in the loop.


The HERMES humanoid system: A platform for full-body teleoperation with balance feedback

Describes the design principles that are the key for the development of the BFI and the MoCap suit. Presents the control strategy used for the force controller and also the mapping between CoP and body force and also the kinematic mapping between robot and operator. Has xperimental results for diffe

A balance feedback interface for whole-body teleoperation of a humanoid robot and implementation in the HERMES system

A full-body teleoperation system for human-in-the-loop control of a humanoid robot.

