COS-7 cell imaged with SMLM
COS-7 cell imaged with SMLM

Image: Reconstruction by Artur Speiser et. al., data provided by Wesley Legant et. al.

Biological image analysis

Machine learning accelerates super-resolution microscopy

Scientists use super-resolution microscopy to study previously undiscovered cellular worlds, revealing nanometer-scale details inside cells.

This method revolutionized light microscopy and earned its inventors the 2014 Nobel Prize in Chemistry. In an international collaboration, AI researchers from Tübingen have now developed an algorithm that significantly accelerates this technology.

Single-molecule localization microscopy (SMLM) is a type of super-resolution microscopy. It involves labelling proteins of interest with fluorescent molecules and using light to activate only a few molecules at a time. Using this trick, multiple images of the same sample are acquired. To create a meaningful picture, a computer program unscrambles the data and compiles the complete image. While the technique can be used to locate molecules with high precision, it has one major drawback – it requires scientists to acquire a large number of images, which makes the process very time-consuming. In an international collaboration, the team of Jakob Macke, Professor for Machine Learning in Science at the University of Tübingen, has developed a new algorithm that overcomes this limitation of SMLM. The joint work with the Ries Group at the European Molecular Biology Laboratory (EMBL) Heidelberg and Dr. Srinivas Turaga's team at Janelia Research Campus (Virginia, USA) was published in Nature Methods.

We originally developed the ideas underlying the machine learning approach in a very different context, but through collaborating with experts in computational microscopy we were able to turn them into powerful methods for analyzing SMLM data

Jakob Macke

The DECODE (DEep COntext DEpendent) algorithm is based on deep learning: It uses a neural network that learns from training data. Instead of using real images, however, the network in this case is trained with synthetic data generated by a numerical simulation. By incorporating information about the microscopic setup and the imaging physics, the researchers achieved simulations that closely matched real-world acquisitions. "The neural network that we trained using simulated data can thus also detect and localize fluorophores in real images", explains Artur Speiser, who, together with Lucas-Raphael Müller, was the lead author of the paper.

One of the benefits of DECODE is that it accurately detects and localizes fluorophores at higher densities than were previously possible. This means that fewer images are needed per sample. As a result, imaging speeds can be increased up to tenfold with minimal loss of resolution. In addition, DECODE can quantify uncertainties – so the network itself can detect when it is unsure of its localization. “This work is indicative of the approach of our Cluster of Excellence ‘Machine Learning: New Perspectives for Science’”, Macke says, whose chair is part of the Tübingen cluster. “We originally developed the ideas underlying the machine learning approach in a very different context, but through collaborating with experts in computational microscopy we were able to turn them into powerful methods for analyzing SMLM data.”

The team has also built a software package which implements the DECODE algorithm. “The software is simple to install and free to use, so we hope it will be useful for many scientists in the future”, adds Dr. Jonas Ries from EMBL.


Source: University of Tübingen

09.09.2021

Read all latest stories

Related articles

Photo

Better quality

Machine learning improves photoacoustic microscopy images

Researchers at the McKelvey School of Engineering at Washington University in St. Louis found a way to significantly reduce the noise and maintain image quality while reducing the laser energy needed…

Photo

Non-invasive diagnostics

Detecting bladder cancer with atomic force microscopy

A research team led by Tufts University engineers has developed a non-invasive method for detecting bladder cancer that might make screening easier and more accurate than current invasive clinical…

Photo

Lesions

'Virtual histology' may reduce need for skin biopsies

A 'new technology shows promise by analyzing images of suspicious-looking lesions and quickly producing a detailed, microscopic image of the skin, bypassing several standard steps typically used for…

Related products

Hund – H 600 AFL 100

Microscopy

Hund – H 600 AFL 100

Helmut Hund GmbH
Hund – medicus pro Myko

Microscopy

Hund – medicus pro Myko

Helmut Hund GmbH
Olympus – BX53LED

Microscopy

Olympus – BX53LED

Olympus Europa SE & Co. KG
Olympus – CX33

Microscopy

Olympus – CX33

Olympus Europa SE & Co. KG
Olympus – SC180

Microscopy

Olympus – SC180

Olympus Europa SE & Co. KG