Intel, Google, UC Berkeley

Scientists use videos to train robot to do sutures

In a collaboration between Google Brain, Intel Corporation and the University of California, Berkeley, researchers have 'trained' robots to mimic surgical procedures through the use of instructional videos.

UC Berkeley professors have previously used YouTube videos as a guide for robots to learn various motions such as jumping or dancing, while Google has trained robots to understand depth and motion. The team applied that knowledge to their latest project, Motion2Vec, in which videos of actual surgical procedures are used for instruction. In a recently released research paper, researchers outline how they used YouTube videos to train a two-armed da Vinci robot to insert needles and perform sutures on a cloth device.

The medical team relied on Siamese networks, a deep-learning setup that incorporates two or more networks sharing the same data. The system is optimal for comparing and assessing relationships between datasets. Such networks have been used in the past for facial detection, signature verification and language detection.


Read the full article here: https://techxplore.com/news/2020-06-intel-google-uc-berekely-ai.html

More information: 

sites.google.com/view/motion2vec
www.ajaytanwani.com/docs/Tanwa … n2Vec_arxiv_2020.pdf

Source: Peter Grad , Tech Xplore

19.06.2020

Read all latest stories

Related articles

Photo

Intelligent surgical unit

Advancing robotic surgery with machine vision capabilities

TransEnterix, Inc., a medical device company that is digitizing the interface between the surgeon and the patient to improve minimally invasive surgery, announced that Hackensack Meridian Health…

Photo

Surgical interventions

Technology and team spirit to ensure future talent

The number of surgical interventions in Germany over the last ten years has increased by around 30%, but it would be wrong to talk of a heyday – mainly due to a lack of young talent, says Prof. Dr.…

Photo

Cutting-edge

Taiwan companies present latest equipment advances

The healthcare system of Taiwan, renowned for its ability to tackle challenges, has held up very well during the COVID-19 pandemic. To underline the nation’s role as a healthcare innovator, the…

Related products

Intermedical – "New" Radius XP with flat panel

Surgical Flat Panel C-Arms

Intermedical – "New" Radius XP with flat panel

INTERMEDICAL SRL
Stephanix – Omniscop DReam S

Surgical Flat Panel C-Arms

Stephanix – Omniscop DReam S

STEPHANIX