Zhong Junwen: The AI magician enabling virtual sensation of real objects

A three-centimetre-long electronic insect scuttles across a dark, maze-like disaster simulation area, carrying out instructions to aid in rescue operations with flexible and agile movements. This is a demonstration conducted by Zhong Junwen, assistant professor in the Department of Electromechanical Engineering in the Faculty of Science and Technology at the University of Macau (UM) and a member of the UM Centre for Artificial Intelligence and Robotics. The electronic insect is one of the flexible robots developed by Prof Zhong in the Soft Sensors-Actuators-Robots Laboratory at UM. Currently, this young up-and-coming scholar is advancing research in flexible smart materials, aiming to equip robots with the ability to transmit tactile sensations.

Bringing childhood fantasies to life

Like many children, Prof Zhong had many whimsical fantasies when he was a boy. One of his dreams was to hug a lion at the zoo and stroke its mane to feel the soft fur of the majestic animal. Now, in his early thirties, Prof Zhong is bringing these childhood fantasies to life through groundbreaking research. He is collaborating with Chimelong Group to develop an innovative smart glove. This glove, when paired with VR glasses, provides users with an immersive experience, allowing them to feel the texture of various animal furs and observe the animals’ reactions to human touch.

Indeed, this smart glove was not developed from scratch. During the COVID-19 pandemic, Prof Zhong and his doctoral students developed a flexible smart material for use in smart clothing. This innovative fabric is capable of transmitting tactile sensations, allowing people who are physically distant to feel each other’s touch and simulate hugs when wearing the garments. Building on this technology, the material’s functionality has been expanded and adapted for the smart glove, enabling users to experience virtual sensation of real objects. 

‘Flexible’ is a keyword in Prof Zhong’s research. Unlike their rigid counterparts, flexible materials are characterised by their ultra-softness, low modulus, and high deformability, which make them ideal for capturing motion perception and tactile feedback. Prof Zhong emphasises the significance of advancing human-computer interaction technology through the research and development of flexible smart materials. These materials not only enable children to explore the world more effectively, but also have extensive applications in home care, disaster detection, and other critical scenarios, where they play a crucial role in enhancing safety and improving outcomes.

Giving robots a sense of touch

As an emerging young scholar, Prof Zhong understands both the significance and challenges of AI research in the contemporary era. He explains, ‘In the field of human-computer interaction, replicating tactile sensations presents significant challenges. Given the extremely complex human perception system, creating a similar system in robots is no easy task.’

Since joining UM in 2020, Prof Zhong has established the Soft Sensors-Actuators-Robots Laboratory. Through this laboratory, he has led his research team in tackling challenges in the design of flexible smart technologies. His goal is to equip robots with sensory capabilities similar to those of human skin, thereby enabling a robotic ‘sense of touch’. In addition, he aims to foster greater interdisciplinary integration of AI research.

Currently, Prof Zhong’s team is developing smart clothing that can monitor the health status of elderly individuals and transmit health signals in real time. He explains, ‘In the event of an accident, this smart clothing can detect the dangerous condition of the elderly individual and upload the health data to the cloud immediately. This allows medical staff to be alerted immediately and respond promptly.’

Prof Zhong also highlights the crucial role of human-computer technology in managing emergency tasks during disaster scenarios. His team is developing a haptic simulation system for nuclear accident scenarios. He explains, ‘Imagine a nuclear accident occurs, and a robot is sent to the site. It must accurately locate and press the emergency switch to close the valve and stop the nuclear leakage. If human operators only monitor the situation on a screen, they may not be able to verify that the robot has executed the command correctly. However, the human-computer interaction system we are developing allows operators to experience the tactile sensation of pressing the valve, which will significantly increase the accuracy of performing such critical tasks in real situations.’

Venturing into a niche field 

Human-computer interaction is now a popular research topic. Reflecting on how he started his journey into ‘flexible electromechanical technology’, Prof Zhong humorously notes that he chose a niche field involving few researchers. He recalls that sensors were traditionally made from rigid materials and were both large and heavy. A significant turning point occurred when he observed rescue teams using small robots for detection, search, and rescue operations during the Wenchuan earthquake in 2008. At that time, the technology was still underdeveloped and received little attention from the scientific community. However, Prof Zhong recognised that flexible electromechanical systems would become crucial technologies for the development of future intelligent robots. He believed that the less mature a technology is, the more worthwhile it is to explore, as it holds significant breakthrough potential. 

Later, while working as a postdoctoral researcher in California, US, Prof Zhong developed new ideas for disaster relief robots. Living in an area heavily infested with American cockroaches, he struggled to control them despite setting numerous traps in his dormitory. The cockroaches consistently managed to escape, frustrating Prof Zhong but also sparking his curiosity about the potential advantages of their resilience and agility. He started to wonder if the flexible bodies and agile movements of insects could be replicated into the design of flexible robots. Inspired by this experience, Prof Zhong and his team initiated a research project that spanned several years. In 2012, they successfully developed a novel electronic insect at UM.

Standing just three centimetres tall and characterised by its high agility and controllability, this electronic insect was capable of recording and transmitting valuable information during search and rescue operations. Moreover, it outperformed existing flexible robots at the time—it was able to navigate a 1.2-metre-long maze in 5.6 seconds and carry a 180 mg gas sensor to detect gas leaks. This groundbreaking research was later published in the prestigious international journal Science Robotics.

With his dedication to research in flexible electromechanical systems, Prof Zhong has made significant achievements. He has published more than 50 academic papers in international journals in recent years, accumulating 8,500 citation counts in total. He highlights that UM professors in the field of science and technology come from diverse backgrounds and have distinct and innovative research interests, fostering an environment conducive to interdisciplinary development. Prof Zhong believes that through the collaborative efforts of faculty and students, artificial intelligence and robotics will become signature UM disciplines.

Using the laboratory as a training ground

UM’s Soft Sensors-Actuators-Robots Laboratory is always bustling with undergraduate students who immerse themselves in research and enjoy discussing with Prof Zhong the challenges they encounter during experiments. Under Prof Zhong’s guidance, these students participate in research projects and gain hands-on experience with the entire experimental process. Interestingly, many of these students do not have backgrounds in mechanical or electrical engineering. Prof Zhong explains that involving students from various disciplines in research promotes interdisciplinary development and enhances the potential for new discoveries.

Prof Zhong continues, ‘In my laboratory, I encourage discussions among students from different disciplines, as this can spark innovative ideas and inspire new research directions. Without such interactions, the laboratory would become stagnant. I have only one requirement for students who come to the laboratory: they must possess a solid understanding of the basics of physics and chemistry. With this strong foundation, they can tackle any challenge that comes their way.’ This requirement, while it may seem unusual, is related to Prof Zhong’s educational background. Prof Zhong initially studied chemistry as an undergraduate before discovering his research passion and shifting to electrical science and engineering for his PhD. Reflecting on this journey, Prof Zhong expresses gratitude for his determination to overcome challenges. His perseverance solidified his foundation in chemistry and deepened his understanding of chemical materials and devices. This background later proved to be invaluable as he ventured into the development of flexible circuit systems.

Prof Zhong believes that a solid foundation is essential for achieving greater success, so he emphasises the importance of mastering fundamental knowledge. Over the years, his laboratory has served as a training ground for students. Undergraduates who have undergone laboratory training often receive better offers for further studies after graduation, thanks to their robust knowledge base and strong interdisciplinary thinking. Prof Zhong shares one notable example, an undergraduate student who had a keen interest in aquatic insects. In his second year, this student collaborated with a doctoral student to develop an aquatic insect robot, which achieved impressive results in practical applications.

Prof Zhong continues, ‘This student gained substantial fundamental knowledge and research experience in my laboratory. I wrote him a letter of recommendation for a master’s degree programme at my alma mater, the University of California, Berkeley. He not only completed his master’s there, but is now pursuing a PhD at Purdue University.’

The ultimate goal: publishing a seminal book

As the saying goes, ‘If you are not moving forward, you are falling behind.’ Prof Zhong believes that in today’s rapidly evolving digital era, particularly with the advancements of AI technology, it is crucial for researchers to enhance their knowledge and skills while maintaining a humble and curious attitude. Therefore, he often reminds students that even after they have developed new technology, they must continue learning and stay abreast of the latest AI robotics trends. He notes, ‘In academia, you cannot rest on your laurels and expect to sustain a career.’ With this perspective, Prof Zhong is committed to acquiring new knowledge and exploring new discoveries. His ultimate goal is to write a book that encapsulates his research findings. The young scholar shares his ultimate dream: ‘I hope to publish a seminal book that becomes a key reference in the field. Seeing my book on shelves in bookstores around the world is my most ambitious goal.’