Intel, Google, UC Berkeley

Scientists use videos to train robot to do sutures

In a collaboration between Google Brain, Intel Corporation and the University of California, Berkeley, researchers have 'trained' robots to mimic surgical procedures through the use of instructional videos.

UC Berkeley professors have previously used YouTube videos as a guide for robots to learn various motions such as jumping or dancing, while Google has trained robots to understand depth and motion. The team applied that knowledge to their latest project, Motion2Vec, in which videos of actual surgical procedures are used for instruction. In a recently released research paper, researchers outline how they used YouTube videos to train a two-armed da Vinci robot to insert needles and perform sutures on a cloth device.

The medical team relied on Siamese networks, a deep-learning setup that incorporates two or more networks sharing the same data. The system is optimal for comparing and assessing relationships between datasets. Such networks have been used in the past for facial detection, signature verification and language detection.


Read the full article here: https://techxplore.com/news/2020-06-intel-google-uc-berekely-ai.html

More information: 

sites.google.com/view/motion2vec
www.ajaytanwani.com/docs/Tanwa … n2Vec_arxiv_2020.pdf

Source: Peter Grad , Tech Xplore

19.06.2020

Read all latest stories

Related articles

Photo

Over the next decade

Robotics set to transform spinal surgery for millions

Robotics, AI, and machine learning can make spinal surgery more accurate, efficient, and safer, thereby reducing costs, patient recovery time, and radiation exposure.

Photo

Surgical robotics

Elevating outcomes of surgery

What’s in a name? In the case of Asensus Surgical, Inc., previously known as TransEnterix, Inc., the recent rebranding doubles as a mission statement for the manufacturer of surgical robotics…

Photo

Intelligent surgical unit

Advancing robotic surgery with machine vision capabilities

TransEnterix, Inc., a medical device company that is digitizing the interface between the surgeon and the patient to improve minimally invasive surgery, announced that Hackensack Meridian Health…

Related products

Agfa - Smart XR

Accessories/ Complementary Systems

Agfa - Smart XR

Agfa HealthCare
Canon - Advanced Intelligent Clear-IQ Engine for CT

Artificial Intelligence

Canon - Advanced Intelligent Clear-IQ Engine for CT

Canon Medical Systems Europe B.V.
Canon – Advanced intelligent Clear-IQ Engine for MR

Artificial Intelligence

Canon – Advanced intelligent Clear-IQ Engine for MR

Canon Medical Systems Europe B.V.
Canon - Aquilion Exceed LB

Oncology CT

Canon - Aquilion Exceed LB

Canon Medical Systems Europe B.V.
Canon - HIT Automation Platform

Artificial Intelligence

Canon - HIT Automation Platform

Canon Medical Systems Europe B.V.
Canon Medical - CT Scan Unit

Mobile CT Solutions

Canon Medical - CT Scan Unit

Canon Medical Systems Europe B.V.
Subscribe to Newsletter