Video • Intel, Google, UC Berkeley

Scientists use videos to train robot to do sutures

In a collaboration between Google Brain, Intel Corporation and the University of California, Berkeley, researchers have 'trained' robots to mimic surgical procedures through the use of instructional videos.

UC Berkeley professors have previously used YouTube videos as a guide for robots to learn various motions such as jumping or dancing, while Google has trained robots to understand depth and motion. The team applied that knowledge to their latest project, Motion2Vec, in which videos of actual surgical procedures are used for instruction. In a recently released research paper, researchers outline how they used YouTube videos to train a two-armed da Vinci robot to insert needles and perform sutures on a cloth device.

The medical team relied on Siamese networks, a deep-learning setup that incorporates two or more networks sharing the same data. The system is optimal for comparing and assessing relationships between datasets. Such networks have been used in the past for facial detection, signature verification and language detection.


Read the full article here: https://techxplore.com/news/2020-06-intel-google-uc-berekely-ai.html

More information: 

sites.google.com/view/motion2vec
www.ajaytanwani.com/docs/Tanwa … n2Vec_arxiv_2020.pdf

Source: Peter Grad , Tech Xplore

19.06.2020

Read all latest stories

Related articles

Photo

News • AI-GUIDE system

Handheld robot can help stem fatal blood loss

The AI-Guided Ultrasound Intervention Device is a lifesaving technology that helps a range of users deliver complex medical interventions at the point of injury.

Photo

News • Over the next decade

Robotics set to transform spinal surgery for millions

Robotics, AI, and machine learning can make spinal surgery more accurate, efficient, and safer, thereby reducing costs, patient recovery time, and radiation exposure.

Photo

Article • Surgical robotics

Elevating outcomes of surgery

What’s in a name? In the case of Asensus Surgical, Inc., previously known as TransEnterix, Inc., the recent rebranding doubles as a mission statement for the manufacturer of surgical robotics…

Related products

Siemens Healthineers - Corindus CorPath GRX

Accessories / Complementary Systems

Siemens Healthineers - Corindus CorPath GRX

Siemens Healthineers
Agfa HealthCare – Rubee for AI

Artificial Intelligence

Agfa HealthCare – Rubee for AI

Agfa HealthCare
Canon – Advanced intelligent Clear-IQ Engine for MR

Artificial Intelligence

Canon – Advanced intelligent Clear-IQ Engine for MR

Canon Medical Systems Europe B.V.
Canon - Aquilion Exceed LB

Oncology CT

Canon - Aquilion Exceed LB

Canon Medical Systems Europe B.V.
Canon – Aquilion Lightning

20 to 64 Slices

Canon – Aquilion Lightning

Canon Medical Systems Europe B.V.
Canon – Aquilion Lightning SP

Volume CT

Canon – Aquilion Lightning SP

Canon Medical Systems Europe B.V.
Subscribe to Newsletter