Intel, Google, UC Berkeley

Scientists use videos to train robot to do sutures

In a collaboration between Google Brain, Intel Corporation and the University of California, Berkeley, researchers have 'trained' robots to mimic surgical procedures through the use of instructional videos.

UC Berkeley professors have previously used YouTube videos as a guide for robots to learn various motions such as jumping or dancing, while Google has trained robots to understand depth and motion. The team applied that knowledge to their latest project, Motion2Vec, in which videos of actual surgical procedures are used for instruction. In a recently released research paper, researchers outline how they used YouTube videos to train a two-armed da Vinci robot to insert needles and perform sutures on a cloth device.

The medical team relied on Siamese networks, a deep-learning setup that incorporates two or more networks sharing the same data. The system is optimal for comparing and assessing relationships between datasets. Such networks have been used in the past for facial detection, signature verification and language detection.


Read the full article here: https://techxplore.com/news/2020-06-intel-google-uc-berekely-ai.html

More information: 

sites.google.com/view/motion2vec
www.ajaytanwani.com/docs/Tanwa … n2Vec_arxiv_2020.pdf

Source: Peter Grad , Tech Xplore

19.06.2020

Read all latest stories

Related articles

Photo

Surgical interventions

Technology and team spirit to ensure future talent

The number of surgical interventions in Germany over the last ten years has increased by around 30%, but it would be wrong to talk of a heyday – mainly due to a lack of young talent, says Prof. Dr.…

Photo

Science fiction meets medical reality

Tectales.com – our new platform for emerging technologies

Today, advances in healthcare are more than ever driven by information technology and (bio)engineering. From 3D printed and smart bionic prosthetics to augmented surgeries and AI – what used to be…

Photo

More power for interventionists

Combining image-guided diagnosis and robot-assisted treatment

Siemens Healthineers AG took a big step last October. To incorporate treatment along an entire clinical path, the firm acquired Corindus Vascular Robotics, Inc., to combine image-guided diagnosis…

Related products

Intermedical – "New" Radius XP with flat panel

Surgical Flat Panel C-Arms

Intermedical – "New" Radius XP with flat panel

INTERMEDICAL SRL
Stephanix – Omniscop DReam S

Surgical Flat Panel C-Arms

Stephanix – Omniscop DReam S

STEPHANIX