<h2 id="isPasted">What Dance Would You Like to Perform with Unitree G1?</h2>With the upgraded algorithm, G1 can learn any dance. Leave a comment to tell us what dance you'd like to see！

With the upgraded algorithm, G1 can learn any dance. Leave a comment to tell us what dance you'd like to see！

What Dance Would You Like to Perform with Unitree G1?

Hello everyone, let me introduce myself again. I am Unitree H1 "Fuxi".&nbsp;I am now a comedian at the Spring Festival Gala, hoping to bring joy to everyone.&nbsp;Let’s push boundaries every day and shape the future together.A little surprise: the handkerchief can not only spin but can also be thrown out and automatically returned to its position.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzM4MDc3NzEzOTI3LeW+ruS/oeWbvueJh18yMDI1MDEyODIzMDMzNy5qcGciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 100%px;" class="fr-fic fr-dib">

Debut at the Spring Festival Gala

Unitree H1: Humanoid Robot Makes Its Debut at the Spring Festival Gala

Unitree H1&nbsp;Deep Reinforcement Learning&nbsp;In-place Flipping Parameters:&nbsp;Weight: about 50kg&nbsp;Height: about 1.8m&nbsp;Actuator: electric motor

Deep Reinforcement Learning

Unitree H1

Unitree G1 Bionic: Agile Upgrade

We’ve adapted motion capture data for Unitree H1, H1-2, and G1 humanoid robots, using numerical optimization methods to make their movement trajectories more natural.&nbsp;Open-Source：<a tabindex="0" href="https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbnp6ZlVPN3FwdWRUQ0JISVV0emRpYlBfbkRpQXxBQ3Jtc0tuUEJPbGJ6d3pQUEFOUDJmRVMwcjdXNXZTbnp2TGIzbGhwcUlGcVdrOXBYS0JpMHU1R2RkVVJBS1dBcGVpZU9BXzJpd3N5OTEtSzcxSjh0MEdHZkZaa25fTENDMWMwaVNqNVJrRm9fX0xEdFRBeDFxOA&q=https%3A%2F%2Fhuggingface.co%2Fdatasets%2Funitreerobotics%2FLAFAN1_Retargeting_Dataset&v=SdZoEke0GPk" rel="nofollow" target="_blank">https://huggingface.co/datasets/unitr...</a>

We’ve adapted motion capture data for Unitree H1, H1-2, and G1 humanoid robots, using numerical optimization methods to make their movement trajectories more natural.

Unitree Humanoid Robots Updated With Open-Source Full-Body Motion Dataset

The humanoid robot driven by the robot AI world model unlocks many new skills!&nbsp;Strong power is waiting for you to develop!Breaking the full-size humanoid speed world record of 3.3m/s (the previous record was about 2.5m/s) Full body dynamic coordinated dance: Subject3&nbsp;Touch the height in place etc.&nbsp;More introduction: www.unitree.com/h1 <h2> </h2>

[full-size humanoid] Evolution V3.0

Unitree H1 Breaking humanoid robot speed world record

Embodied AI, Price below $90k Preview over half-a-year achievement The highest-power-performance robot of its counterparts with similar specifications in the world, weigh ~47Kg, maximum joint torque of 360N.m For more product information, please contact us through our official website:&nbsp;<a tabindex="0" href="https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqa2lqY1IxNDEyVl9UX1hYTHJLNjhMcVh0bk5Td3xBQ3Jtc0ttMW1hRjdha2NoQjVTYlZiTDhzTzlOQmZsYlY2QlpjSEhFOER1eHJ4UmxwejJGQlpRVXFzRXlwTzZiSDVQdFpLQWlpYUxTRk54QWJlQ2N2MEFQd2JxV3M2b3FDdlc1NWIyNlJBSmc3NGxLLU9INkdwcw&q=https%3A%2F%2Fwww.unitree.com%2Fh1&v=q8JMX6PGRoI" rel="nofollow" target="_blank">https://www.unitree.com/h1</a>

Price below $90k

Unitree General-pupose Humanoid Robot H1 Evolution V2.0

Researchers at the Italian Institute of Technology (IIT) are transforming human-robot collaboration with adaptive interfaces, enabling real-time robot adjustments and safe, seamless interactions.Key takeaways:<ul><li>Real-time adaptation for collaboration:&nbsp;Sirintuna and Ozdamar developed an adaptive collaborative interface (ACI) that allows robots to adjust their actions to the human movement intention in real-time, improving teamwork and efficiency.</li><li>Safety and predictability:&nbsp;Safety protocols and torque-controlled robots reduce risks in human-robot interaction, though unpredictable human behavior remains a challenge.</li><li>Xsens motion capture: The researchers use Xsens for precise, continuous movement data, crucial for interpreting human intentions and enabling seamless robot-human collaboration.</li><li>Future applications:&nbsp;The research has potential in healthcare, emergency response, and home assistance, aiming for robots that adapt intuitively in real-life, unstructured environments.&nbsp;</li></ul>Humans have been working with machines for centuries, and with the ongoing robotics revolution, this collaboration is becoming more equal. Researchers Doganay Sirintuna and Idil Ozdamar from the Italian Institute of Technology (IIT) are at the forefront of this change, investigating how robots can effectively work with humans in tasks such as carrying and delivering objects.&nbsp;The new challenge&nbsp;IIT has been actively researching human-robot collaboration for several years, showcasing robots that can perform a variety of tasks, from assisting in drilling holes to serving cups of coffee. &nbsp;Researchers Doganay Sirintuna and Idil Ozdamar, from the Human-Robot Interfaces and Interaction Laboratory, are developing a framework that allows robots to assist with transporting objects. Their framework, called Adaptive Collaborative Interface (ACI) uses haptic feedback and motion capture data to enable robots to adjust their speed and position for better teamwork with humans.&nbsp;In Ozdamar's study, “<a href="https://arxiv.org/abs/2209.14009" target="_blank" rel="noopener noreferrer">Carrying the Uncarriable: A Deformation-Agnostic and Human-Cooperative Framework for Unwieldy Objects Using Multiple Robots</a>,” a framework is presented for one person and two robots to carry a large, deformable object using flexible straps. In a related study by Sirintuna and Ozdamar, “<a href="https://arxiv.org/abs/2201.10392" target="_blank" rel="noopener noreferrer">Human-Robot Collaborative Carrying of Objects with Unknown Deformation Characteristics</a>,” they explore handling items from flexible ropes to rigid rods. By analyzing human movements and force feedback, robots can detect the deformability of the handled objects and adapt their actions. &nbsp;<iframe width="640" height="360" src="https://www.youtube.com/embed/Q3sA6YzTaaE?&amp;wmode=opaque&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe>Sirintuna and Ozdamar's research focuses on robots consisting of a base with wheels (mobile manipulators) and a robotic arm with multiple joints (known as collaborative robots or cobots). They explain, "In our setup, we have 9° of freedom, and with wheeled robots, you can perform fast movements. So, we selected an industrial robot to concentrate on collaboration tasks."&nbsp;The choice of Xsens &nbsp;In their work, Sirintuna and Ozdamar rely heavily on <a href="https://www.movella.com/products/motion-capture" target="_blank" rel="noopener noreferrer">Xsens motion capture</a> to collect accurate movement data to guide the robots. Xsens allows the researchers to conduct the experiments with minimal setup—making it a practical choice for laboratory environment. Sirintuna and Ozdamar stress the importance of precise, continuous data when working in close collaboration with humans. They appreciate Xsens’ reliability, noting, “We used Xsens because its data was very continuous, which allowed us to provide a reliable stream of data for the human-robot collaboration. Optical sensors we have tried can experience jumps in position, affecting the performance of our framework.”&nbsp;A key focus of their research is interpreting human intentions through movement data. Xsens provides detailed kinematic data, enabling them to categorize actions such as standing still, pushing, or pulling. Through repeated training, they achieved a 98% accuracy in predicting human movements within just three months. “We label specific joint positions and angles as pushing or pulling and use these as input for our system,” Ozdamar explains. Sirintuna and Ozdamar also developed an algorithm that interprets human’s rotational intent by analyzing torso and hand movements, with the goal of creating robots that assist efficiently in tasks like turning while carrying objects. &nbsp;The research results &nbsp; As a result of applying the adaptive collaborative interface, Sirintuna and Ozdamar found that cobots can handle tasks with higher precision, anticipating human movements in real time and adjusting actions based on nuanced data. With the help of a robot operating under ACI in the research on the different deformable objects, "participants completed the task faster, with less effort and higher effectiveness". In the research with two robots assisting one person with transporting a bulky object using deformable straps, the ACI allowed robots to have faster response and better alignment of the movement and required a lesser force input from the person, making the lifting task easier.&nbsp;The findings underscore the power of applying ACI for human-robot collaboration scenarios and lay a foundation for future research in this area.&nbsp;<iframe width="640" height="360" src="https://www.youtube.com/embed/ounQmCdYlC4?&amp;wmode=opaque&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe> The future of human-robot collaboration and humanoids&nbsp;Looking ahead, Sirintuna and Ozdamar see their research supporting applications in healthcare, emergency response, and home assistance, as well as enabling robots to become common in public spaces and workplaces to meet needs, for example, in agriculture, affected by climate change. The researchers note that “human-robot teams that leverage human adaptability and decision-making can perform tasks with the flexibility required in unstructured environments.”&nbsp;However, making this robotized future reality requires addressing safety concerns in human-robot collaboration. The research robots are torque-controlled, equipped with soft joints, and programmed to avoid reacting to unexpected high-velocity impacts or large force inputs. Yet, as the researchers point out, for real-world applications, the unpredictability of human behavior remains the greatest challenge. “We design algorithms based on expected movements, but humans often behave in unexpected ways,” says Sirintuna. Ozdamar adds, “We can ensure slightly more safety on the robots’ side than on a person’s because we can predict the robot’s behavior.”&nbsp;Ultimately, Sirintuna and Ozdamar’s work lays a foundation for future robots capable of safe, intuitive collaboration with humans, bringing us closer to a world where robots seamlessly assist in our daily lives.&nbsp;

By Xsens MVN Analyze

IIT Develops Adaptive Collaborative Interface for Safe Human-Robot Interaction with Xsens motion capture

In order to promote the development of the global embodied AI industry, the Unitree G1 robot operation data set is open sourced, adapted to a variety of open source solutions, and continuously updated:&nbsp;Open source data collection:&nbsp;<a tabindex="0" href="https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqa3VhODBhSF8tQzQtdFlpaUk2blczM2t1WFdkd3xBQ3Jtc0ttTkF6bzFrSzVTbkk5elFNaXl4ZmZyQTE5VGFfbWpESlhxVS1VRklKVXozX2JrZ2ItekNReGx3Vm5QOHY2OGxER0diUUhhTWlBdmotSU9LUV9EcWV0dC00Y3pjTWpyQXlQUTU5RmZCYjhoRl9KeXhadw&q=https%3A%2F%2Fgithub.com%2Funitreerobotics%2Favp_teleoperate&v=OTWHXTu09wE" rel="nofollow" target="_blank" data-immersive-translate-walked="dc553b62-3d51-4d74-bb21-9b5c19549e6f">https://github.com/unitreerobotics/av...</a>Open source learning algorithms:&nbsp;<a tabindex="0" href="https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbFVfRV9DS25fNFpSMXVpaEJicUFBV29QY2NYd3xBQ3Jtc0tuejRtek9OWDF5Qk9Fc0FRNUhzWkl0SEdDSFM4UFRHLWk2MHdOUjR3LWxwN0JlUmxGRkJ5TjhlbE83S0hlZEhDY0IxQmFiOGJaM0MxRFVtdmtta3ZMMWVCOXlQMS1WR2hJa0hla0RtVHpvZWlQc3pPZw&q=https%3A%2F%2Fgithub.com%2Funitreerobotics%2Funitree_IL_lerobot&v=OTWHXTu09wE" rel="nofollow" target="_blank" data-immersive-translate-walked="dc553b62-3d51-4d74-bb21-9b5c19549e6f">https://github.com/unitreerobotics/un...</a>Open source datasets and models:&nbsp;<a tabindex="0" href="https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbGh0clVCMHBNbkpPWTczdTFjSGtWNGFfLVowUXxBQ3Jtc0trV2VfWFBrLUVNNS1oM3JNR2ZEU0d0MnlYZXhBNDVQVjNfYkN1aGd1b3BMc3JHUGtNTnFBN0JSMi1CQUJHSnRUTzZMTWNIZnJNQ29IUmNtT2t1blZkRXJ3ZEtfZmRKYVdqUGk1OWNZSUl4d1g5Qk16MA&q=https%3A%2F%2Fhuggingface.co%2FUnitreeRobotics&v=OTWHXTu09wE" rel="nofollow" target="_blank" data-immersive-translate-walked="dc553b62-3d51-4d74-bb21-9b5c19549e6f">https://huggingface.co/UnitreeRobotics</a>

In order to promote the development of the global embodied AI industry, the Unitree G1 robot operation data set is open sourced, adapted to a variety of open source solutions, and continuously updated.

Unitree G1 Open Source Dataset

<article data-clipboard-cangjie='["root",{},["p",{},["span",{"data-type":"text"},["span",{"fonts":{"ascii":"微软雅黑","cs":"微软雅黑","eastAsia":"微软雅黑","hAnsi":"微软雅黑","hint":"eastAsia"},"data-type":"leaf"},"G1 has flexible mechanical dimensions and joint design, including 23-43 degrees of freedom, industrial-grade crossed roller bearings and low-inertia high-speed motors, providing powerful joint output. The maximum torque of the knee joint can reach 120N.m, the maximum load of the arm is about 3Kg, it has a large joint movement space, and is equipped with depth cameras, 3D lidar, 4-microphone array and other perception sensors, as well as an 8-core high-performance CPU. In addition, G1 also provides high computing power modules, smart batteries, chargers and other supporting equipment, supports smart OTA upgrades and secondary development, and is suitable for general humanoids, industry applications, fitness and embodied smart communities and other fields. It is worth mentioning that the price of the G1 bipedal humanoid robot independently developed by Unitree Robotics has been reduced to less than 100,000 for the first time, providing more companies and individuals with the opportunity to contact and apply humanoid robots. "]]]]' id="isPasted">G1 has flexible mechanical dimensions and joint design, including 23-43 degrees of freedom, industrial-grade crossed roller bearings and low-inertia high-speed motors, providing powerful joint output. The maximum torque of the knee joint can reach 120N.m, the maximum load of the arm is about 3Kg, it has a large joint movement space, and is equipped with depth cameras, 3D lidar, 4-microphone array and other perception sensors, as well as an 8-core high-performance CPU.&nbsp;</article>

AI-driven robots need to learn new actions as fast as possible. This is very important.

Learning in 2 Days, Human-Like Natural Walking

The G1 robot can perform a standing long jump of up to 1.4 meters, possibly the longest jump ever achieved by a humanoid robot of its size in the world, standing only 1.32 meters tall; This video showcases some of the new features of the Go2 robot dog, which were updated a while ago but may still be unfamiliar to you. (Note: features vary by model and version) We sincerely hope you find it interesting!

The G1 robot can perform a standing long jump of up to 1.4 meters, possibly the longest jump ever achieved by a humanoid robot of its size in the world, standing only 1.32 meters tall.

Did you exercise today? Breaking Records! G1 Humanoid Robot Achieves a Jump Distance and Height Ratio of Over 1!

Robots, combined with artificial intelligence (AI), are transforming industries such as manufacturing, healthcare, and research. 

AI-enabled robots and the importance of force sensing

Humanoid robots are designed to resemble and mimic human actions and interactions, placing them as a bridge forming collaborations between humans and machines. Their human-like appearance and movements create a sense of relatability and approachability not typically seen in traditional industrial robots. This "personal appeal" has sparked increased interest in developing humanoid robots for diverse applications, such as healthcare, customer service, education, and even space exploration - where human characteristics such as empathy, decision-making making, and personality are deemed valuable. This article provides insights into four of the leading humanoid robot projects from around the world. <h2>Selection Rationale</h2>The humanoid robots selected in this comparison represent the pinnacle of the current state of humanoid robotic technology. Each robot was selected based on its unique contributions to its field, ranging from technical capabilities to broadest application. Each selected robot is also in full production and either available for purchase or being used by their creators in real-time applications. <h2>Optimus by Tesla</h2>Also known as Tesla Bot, this general-purpose, bipedal, autonomous humanoid robot was created to perform unsafe, repetitive, or boring tasks. The company announced the robot's development in August 2021 and showed the prototype in 2022. Tesla's CEO, Elon Musk, claimed that Optimus will eventually be able to do "anything that humans don’t want to do."Tesla's Optimus can sort colored blocks by color, locate its limbs in space, do some yoga, and even poach an egg. In December 2023, Musk released a video showing an Optimus Generation 2 walking and dancing. The new robot features a slimmer figure and sleeker, more precise movements. The robot is planned to measure 5 ft 8 in (173 cm) tall and weigh 125 lb (57 kg), and it will be controlled by the same AI system that Tesla uses in its cars. With a carrying capacity of 45 lb (20 kg), it can provide manufacturing assistance, and Musk has already commented that the robots will be utilized in Tesla’s car factories by the end of 2024 to enhance the factory's efficiency and significantly reduce production costs. The first commercial units of Tesla's Optimus will launch in 2025.<img width="624" src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzE5MDM2NTE5MDk3LTE3MTkwMzY1MTkwOTcucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" class="fr-fic fr-dii" style="width:778px" />Optimus, by Tesla, promises to be the future of automation in manufacturing. Credit: <a href="https://www.tesla.com/en_eu/AI" target="_blank">Tesla</a><h2>Atlas by Boston Dynamics</h2>Atlas, engineered by leading robotic company Boston Dynamics, represents a huge leap forward for robotic mobility and adaptability. Debuting on July 11, 2013, Atlas was designed to traverse and interact with its surroundings with a fluidity and precision reminiscent of human motion. Constructed with robust plastics, titanium, and aluminum 3D printed parts, Atlas was originally   driven by powerful hydraulic actuators, but now, the company has announced a fully electric robot. In widely shared videos, Atlas has demonstrated a broad spectrum of physical prowess, including running, leaping, and executing backflips easily. These types of motion are difficult as they require the robot to self-correct and consider environmental factors. Atlas uses a comprehensive sensor network powered by AI to facilitate meticulous navigation and the proficient completion of multifaceted tasks across diverse landscapes. Such capabilities mean Atlas may have a future in scenarios such as search and rescue or fire management, where its agility and adaptability can be leveraged to great effect. After being acquired by  Hyundai in 2021, the focus will be testing and iterating Atlas applications in manufacturing environments. The company promises that the electric version of Atlas is stronger and has a broader range of motion than previous models. <iframe width="640" height="360" src="https://www.youtube.com/embed/-e1_QhJ1EhQ?&amp;wmode=opaque&amp;rel=0&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0"></iframe> <h2>NAO by Aldebaran</h2>NAO is an autonomous, programmable humanoid robot originally developed by Aldebaran Robotics. SoftBank Robotics acquired the French company in 2015 and released NAO 3. In July 2022, the company was rebranded Aldebaran again.Nao is available as a research robot for schools, colleges and universities to teach programming as well as conducting research into human-robot interactions. Over 5,000 Nao robots are used in 200+ educational and research institutions in 70 countries. The robots are also used in healthcare scenarios, such as care homes.NAO6, the latest version, features 25 degrees of freedom and an inertial measurement unit with an accelerometer, gyroscope, and four ultrasonic sensors that support NAO with stability and movement. The robots are also equipped with seven touch sensors to perceive their environment and their speech recognition is available in 20 languages. The robot also has 5G capabilities. <img width="624" src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzE5MDM2NTE5MTA5LTE3MTkwMzY1MTkxMDkucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" class="fr-fic fr-dii" />From supporting the education of autistic children to helping train International Space Station astronauts and assisting elderly patients in care homes, NAO robots have been integrated into education and healthcare applications. Credit: <a href="https://www.aldebaran.com/de/nao" target="_blank">Aldebaran</a><h2>Ameca by Engineered Arts</h2>Ameca, first developed by Engineered Arts in February 2021, is currently the most advanced human-shaped robot in the market, developed specifically for human-robot interaction. They are modular, upgradable, and easy to develop upon.With embedded microphones, binocular eye-mounted cameras, a chest camera,  and facial recognition software, Ameca's interactions with the public work by GPT-3 or human telepresence. It also has motorized arms, fingers, neck, and facial features on grey rubber skin, designed to appear genderless. Engineered Arts has developed their own hardware, based on proprietory research into humanoid robotics, and built with their Mesmer technology, a system focused on powerful, cost-effective, and realistic humanoid robots.Ameca is currently associated with the Museum of the Future in Dubai (UEA), where people can interact with it. <iframe width="640" height="360" src="https://player.vimeo.com/video/651929733" frameborder="0"></iframe> <h2>Technology Overview </h2> <table><tbody><tr><td>Robot</td><td>Company/Creator</td><td>Vision &amp; Goal</td><td>Materials</td><td>AI Capabilities &amp; Technology</td><td>Applications</td><td>Command &amp; Agility</td></tr><tr><td>Optimus</td><td>Tesla </td><td>Replace humans in manufacturing operations for repetitive and dangerous tasks</td><td>Polyether Ether Ketone (PEEK)</td><td>Tesla-designed actuators and sensors</td><td>Manufacturing support and training</td><td>Carrying capacity of 20kg, can dance, boil eggs, do squats</td></tr><tr><td>Atlas</td><td>Boston Dynamics</td><td>Navigate and manipulate environments with human-like agility</td><td>Titanium and aluminum </td><td>Precise navigation, execution of complex tasks in varied terrains</td><td>Search and rescue, exploration, logistics</td><td>Responsive to commands, capable of running, jumping, performing backflips</td></tr><tr><td>NAO</td><td>Aldebaran</td><td>Human interaction and educational support</td><td>Polycarbonate-ABS plastic, polyamide, and carbon-fiber-reinforced thermoplastic</td><td>Conversational AI, personalized interaction based on facial recognition, collect information </td><td>Education, research, healthcare</td><td>Walk, dance, speak, and recognize faces and objects</td></tr><tr><td>Ameca</td><td>Engineered Arts</td><td>Development platform for testing AI and machine learning systems</td><td>Mesmer technology</td><td>Process complex data, recognize faces, comprehend speech, and adapt to different scenarios</td><td>Human interaction, a platform for developing AI</td><td>Advanced facial expression and human-like interactions</td></tr></tbody></table><h2>Conclusion: The Pioneers of Humanoid Robotics - A Unified Perspective</h2>The exploration of Optimus, Atlas, NAO, and Ameca highlights the remarkable journey and achievements in humanoid robotics. Each robot, distinct in its capabilities and applications, contributes uniquely to the field. From Ameca's social interactions to Atlas's agility, NAO's educational support, and Optimus's manufacturing utility, these pioneers embody the diverse potential of robotics.Their materiality and design philosophies are tailored to specific applications, showcasing innovation in construction and functionality. The AI and technological advancements across these robots cover a broad spectrum, enabling them to perform tasks ranging from basic interactions to complex, autonomous problem-solving. Their deployment in healthcare, customer service, manufacturing exploration, and emergency response illustrates the expanding role of robotics in meeting intricate human needs.The integration of sophisticated command systems and remarkable agility demonstrates the evolving interface between humans and machines, pushing the boundaries of what humanoid robots can achieve. This unified perspective underlines the transformative impact of humanoid robotics, promising a future where their presence becomes an integral part of daily life and complex problem-solving across various sectors.

Exploring innovations, capabilities, and the future of robotic companions

A quick engineering comparison of cutting-edge humanoid robots

In this episode, we discuss research coming out of Columbia University to better connect humans with robots by having them detect, process, and respond to facial expressions!

Podcast: Finally! A Humanoid Robot You Can Trust

This article was discussed in our <a href="https://www.wevolver.com/profile/the.next.byte" rel="noopener noreferrer" target="_blank">Next Byte podcast</a>.&nbsp;<iframe height="200px" width="100%" frameborder="no" scrolling="no" seamless="" src="https://player.simplecast.com/f153920a-aca0-4937-863a-2cc925d11434?dark=false" class="fr-draggable" data-gtm-yt-inspected-9="true" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe> The full article will continue below.<hr>Columbia engineers build Emo, a silicon-clad robotic face that makes eye contact and uses two AI models to anticipate and replicate a person’s smile before the person actually smiles -- a major advance in robots predicting human facial expressions accurately, improving interactions, and building trust between humans and robots.<section id="isPasted">What would you do if you walked up to a robot with a human-like head and it smiled at you first? You’d likely smile back and perhaps feel the two of you were genuinely interacting. But how does a robot know how to do this? Or a better question, how does it know to get you to smile back?While we’re getting accustomed to robots that are adept at verbal communication, thanks in part to advancements in large language models like ChatGPT, their nonverbal communication skills, especially facial expressions, have lagged far behind. Designing a robot that can not only make a wide range of facial expressions but also know when to use them has been a daunting task.&nbsp;</section><section><h2>Tackling the challenge</h2>The <a href="http://engineering.columbia.edu/" rel="nofollow" target="_blank">Creative Machines Lab</a> at <a href="http://engineering.columbia.edu/" rel="nofollow" target="_blank">Columbia Engineering</a> has been working on this challenge for more than five years. In a new study published today in <a href="https://www.science.org/doi/10.1126/scirobotics.adi4724" rel="nofollow" target="_blank">Science Robotics</a>, the group unveils Emo, a robot that anticipates facial expressions and executes them simultaneously with a human. It has even learned to predict a forthcoming smile about 840 milliseconds before the person smiles, and to co-express the smile simultaneously with the person.The team, led by <a href="https://www.engineering.columbia.edu/faculty/hod-lipson" rel="nofollow" target="_blank">Hod Lipson</a>, a leading researcher in the fields of artificial intelligence (AI) and robotics, faced two challenges: how to mechanically design an expressively versatile robotic face which involves complex hardware and actuation mechanisms, and knowing which expression to generate so that they appear natural, timely, and genuine. The team proposed training a robot to anticipate future facial expressions in humans and execute them simultaneously with a person. The timing of these expressions was critical -- delayed facial mimicry looks disingenuous, but facial co-expression feels more genuine since it requires correctly inferring the human's emotional state for timely execution.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzExNTg1NTM0ODUxLXl1aGFuZy1odWEtb2YtY3JlYXRpdmUtbWFjaGluZXMtbGFiLWZhY2UtdG8tZmFjZS13aXRoLWVtby5wbmciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 100%px;" class="fr-fic fr-dib">Yuhang Hu of Creative Machines Lab face-to-face with Emo. Image: Courtesy of Creative Machines Lab<h2 id="isPasted">How Emo connects with you</h2>Emo is a human-like head with a face that is equipped with 26 actuators that enable a broad range of nuanced facial expressions. The head is covered with a soft silicone skin with a magnetic attachment system, allowing for easy customization and quick maintenance. For more lifelike interactions, the researchers integrated high-resolution cameras within the pupil of each eye, enabling Emo to make eye contact, crucial for nonverbal communication.The team developed two AI models: one that predicts human facial expressions by analyzing subtle changes in the target face and another that generates motor commands using the corresponding facial expressions.To train the robot how to make facial expressions, the researchers put Emo in front of the camera and let it do random movements. After a few hours, the robot learned the relationship between their facial expressions and the motor commands -- much the way humans practice facial expressions by looking in the mirror. This is what the team calls “self modeling” – similar to our human ability to imagine what we look like when we make certain expressions.Then the team ran videos of human facial expressions for Emo to observe them frame by frame. After training, which lasts a few hours, Emo could predict people’s facial expressions by observing tiny changes in their faces as they begin to form an intent to smile.“I think predicting human facial expressions accurately is a revolution in HRI. Traditionally, robots have not been designed to consider humans' expressions during interactions. Now, the robot can integrate human facial expressions as feedback,” said the study’s lead author Yuhang Hu, who is a PhD student at Columbia Engineering in Lipson’s lab. “When a robot makes co-expressions with people in real-time, it not only improves the interaction quality but also helps in building trust between humans and robots. In the future, when interacting with a robot, it will observe and interpret your facial expressions, just like a real person.”<iframe width="640" height="360" src="https://www.youtube.com/embed/pWTTzR_wXuQ?&amp;wmode=opaque&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true" data-gtm-yt-inspected-9="true" id="556492795" title="Human-Robot Facial Co-expression">&nbsp;</iframe>Go inside the Creative Machines Lab to watch Emo's facial co-expression. Video Credit: Yuhang Hu, Columbia Engineering<h2 id="isPasted">What’s next</h2>The researchers are now working to integrate verbal communication, using a large language model like ChatGPT into Emo. As robots become more capable of behaving like humans, Lipson is well aware of the ethical considerations associated with this new technology.“Although this capability heralds a plethora of positive applications, ranging from home assistants to educational aids, it is incumbent upon developers and users to exercise prudence and ethical considerations,” says Lipson, James and Sally Scapa Professor of Innovation in the Department of <a href="https://www.me.columbia.edu/" rel="nofollow" target="_blank">Mechanical Engineering</a> at Columbia Engineering, co-director of the <a href="https://make.columbia.edu/" rel="nofollow" target="_blank">Makerspace</a> at Columbia, and a member of the <a href="https://datascience.columbia.edu/" rel="nofollow" target="_blank">Data Science Institute</a>. “But it’s also very exciting -- by advancing robots that can interpret and mimic human expressions accurately, we're moving closer to a future where robots can seamlessly integrate into our daily lives, offering companionship, assistance, and even empathy. Imagine a world where interacting with a robot feels as natural and comfortable as talking to a friend.”&nbsp;</section>

The study's lead author, Yuhang Hu, a PhD student at Columbia Engineering in Hod Lipson’s lab. Credit: John Abbott/Columbia Engineering

Columbia engineers build Emo, a silicon-clad robotic face that makes eye contact and uses two AI models to anticipate and replicate a person’s smile before the person actually smiles 

humanoids

ORGANIZATIONS.

SHAPING THE INDUSTRY.

Unitree Robotics

Franka Robotics

Latest Posts