nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation

Nature Methods, Journal Year: 2020, Volume and Issue: 18(2), P. 203 - 211

Published: Dec. 7, 2020

Language: Английский

---

The Medical Segmentation Decathlon

Nature Communications, Journal Year: 2022, Volume and Issue: 13(1)

Published: July 15, 2022

International challenges have become the de facto standard for comparative assessment of image analysis algorithms given a specific task. Segmentation is so far most widely investigated medical processing task, but various segmentation typically been organized in isolation, such that algorithm development was driven by need to tackle single clinical problem. We hypothesized method capable performing well on multiple tasks will generalize previously unseen task and potentially outperform custom-designed solution. To investigate hypothesis, we Medical Decathlon (MSD) - biomedical challenge, which compete multitude both modalities. The underlying data set designed explore axis difficulties encountered when dealing with images, as small sets, unbalanced labels, multi-site objects. MSD challenge confirmed consistent good performance preserved their average different tasks. Moreover, monitoring winner two years, found this continued generalizing wide range other problems, further confirming our hypothesis. Three main conclusions can be drawn from study: (1) state-of-the-art are mature, accurate, retrained tasks; (2) algorithmic across strong surrogate generalizability; (3) training accurate AI models now commoditized non experts.

Language: Английский

---

CHAOS Challenge - combined (CT-MR) healthy abdominal organ segmentation

Medical Image Analysis, Journal Year: 2020, Volume and Issue: 69, P. 101950 - 101950

Published: Dec. 25, 2020

Language: Английский

---

AnatomyNet: Deep learning for fast and fully automated whole‐volume segmentation of head and neck anatomy

Medical Physics, Journal Year: 2018, Volume and Issue: 46(2), P. 576 - 589

Published: Nov. 27, 2018

Methods: Our deep learning model, called AnatomyNet, segments OARs from head and neck CT images in an end-to-end fashion, receiving whole-volume HaN as input generating masks of all interest one shot. AnatomyNet is built upon the popular 3D U-net architecture, but extends it three important ways: 1) a new encoding scheme to allow auto-segmentation on instead local patches or subsets slices, 2) incorporating squeeze-and-excitation residual blocks layers for better feature representation, 3) loss function combining Dice scores focal facilitate training neural model. These features are designed address two main challenges deep-learning-based segmentation: a) segmenting small anatomies (i.e., optic chiasm nerves) occupying only few b) with inconsistent data annotations missing ground truth some anatomical structures. Results: We collected 261 train used MICCAI Head Neck Auto Segmentation Challenge 2015 benchmark dataset evaluate performance AnatomyNet. The objective segment nine anatomies: brain stem, chiasm, mandible, nerve left, right, parotid gland submandibular right. Compared previous state-of-the-art results competition, increases similarity coefficient by 3.3% average. takes about 0.12 seconds fully image dimension 178 x 302 225, significantly faster than methods. In addition, model able process delineate pass, requiring little pre- post-processing. https://github.com/wentaozhu/AnatomyNet-for-anatomical-segmentation.git.

Language: Английский

---

TorchIO: A Python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learning

Computer Methods and Programs in Biomedicine, Journal Year: 2021, Volume and Issue: 208, P. 106236 - 106236

Published: June 17, 2021

Processing of medical images such as MRI or CT presents different challenges compared to RGB typically used in computer vision. These include a lack labels for large datasets, high computational costs, and the need metadata describe physical properties voxels. Data augmentation is artificially increase size training datasets. Training with image subvolumes patches decreases power. Spatial needs be carefully taken into account order ensure correct alignment orientation volumes.We present TorchIO, an open-source Python library enable efficient loading, preprocessing, patch-based sampling deep learning. TorchIO follows style PyTorch integrates standard processing libraries efficiently process during neural networks. transforms can easily composed, reproduced, traced extended. Most inverted, making suitable test-time estimation aleatoric uncertainty context segmentation. We provide multiple generic preprocessing operations well simulation MRI-specific artifacts.Source code, comprehensive tutorials extensive documentation found at http://torchio.rtfd.io/. The package installed from Package Index (PyPI) running pip install torchio. It includes command-line interface which allows users apply files without using Python. Additionally, we graphical user within extension 3D Slicer visualize effects transforms.TorchIO was developed help researchers standardize pipelines allow them focus on learning experiments. encourages good open-science practices, it supports experiment reproducibility version-controlled so that software cited precisely. Due its modularity, compatible other frameworks images.

Language: Английский

---

Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis

2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Journal Year: 2022, Volume and Issue: unknown, P. 20698 - 20708

Published: June 1, 2022

Vision Transformers (ViT)s have shown great performance in self-supervised learning of global and local representations that can be transferred to downstream applications. Inspired by these results, we introduce a novel framework with tailored proxy tasks for medical image analysis. Specifically, propose: (i) new 3D transformer-based model, dubbed Swin UNEt TRansformers (Swin UNETR), hierarchical encoder pretraining; (ii) the underlying pattern human anatomy. We demonstrate successful pre-training proposed model on 5,050 publicly available computed tomography (CT) images from various body organs. The effectiveness our approach is validated fine-tuning pre-trained models Beyond Cranial Vault (BTCV) Segmentation Challenge 13 abdominal organs segmentation Medical Decathlon (MSD) dataset. Our currently state-of-the-art public test leaderboards both MSD ¹ https://decathlon-10.grand-challenge.org/evaluation/challenge/leaderboard/ BTCV xmlns:xlink="http://www.w3.org/1999/xlink">2 https://www.synapse.org/#!Synapse:syn3193805/wiki/217785/ datasets. Code: https://monai.io/research/swin-unetr.

Language: Английский

---

Loss odyssey in medical image segmentation

Medical Image Analysis, Journal Year: 2021, Volume and Issue: 71, P. 102035 - 102035

Published: March 20, 2021

Language: Английский

---

Modified U-Net (mU-Net) With Incorporation of Object-Dependent High Level Features for Improved Liver and Liver-Tumor Segmentation in CT Images

IEEE Transactions on Medical Imaging, Journal Year: 2019, Volume and Issue: 39(5), P. 1316 - 1325

Published: Oct. 18, 2019

Segmentation of livers and liver tumors is one the most important steps in radiation therapy hepatocellular carcinoma. The segmentation task often done manually, making it tedious, labor intensive, subject to intra-/inter- operator variations. While various algorithms for delineating organ-at-risks (OARs) tumor targets have been proposed, automatic remains intractable due their low tissue contrast with respect surrounding organs deformable shape CT images. U-Net has gained increasing popularity recently image analysis tasks shown promising results. Conventional architectures, however, suffer from three major drawbacks. First, skip connections allow duplicated transfer resolution information feature maps improve efficiency learning, but this leads blurring extracted features. Secondly, high level features by network do not contain enough edge input, leading greater uncertainty where dominantly affects network's decisions such as liver-tumor segmentation. Thirdly, generally difficult optimize number pooling operations order extract global features, since used depends on object size. To cope these problems, we added a residual path deconvolution activation connection avoid duplication In case small inputs, are incorporated path. Furthermore, proposed architecture additional convolution layers inputs well large inputs. Efficacy modified (mU-Net) was demonstrated using public dataset Liver (LiTS) challenge 2017. For segmentation, Dice similarity coefficient (DSC) 89.72 %, volume error (VOE) 21.93 relative difference (RVD) - 0.49 % were obtained. DSC 98.51 VOE 3.07 RVD 0.26 calculated. 3D Image Reconstruction Comparison Algorithm Database (3Dircadb), DSCs 96.01 68.14 segmentations, respectively. mU-Net outperformed existing state-of-art networks.

Language: Английский

---

Artificial intelligence in radiation oncology

Nature Reviews Clinical Oncology, Journal Year: 2020, Volume and Issue: 17(12), P. 771 - 781

Published: Aug. 25, 2020

Language: Английский

---

Overview of artificial intelligence-based applications in radiotherapy: Recommendations for implementation and quality assurance

Radiotherapy and Oncology, Journal Year: 2020, Volume and Issue: 153, P. 55 - 66

Published: Sept. 10, 2020

Artificial Intelligence (AI) is currently being introduced into different domains, including medicine. Specifically in radiation oncology, machine learning models allow automation and optimization of the workflow. A lack knowledge interpretation these AI can hold back wide-spread full deployment clinical practice. To facilitate integration radiotherapy workflow, generally applicable recommendations on implementation quality assurance (QA) are presented. For commonly used applications such as auto-segmentation, automated treatment planning synthetic computed tomography (sCT) basic concepts discussed depth. Emphasis put commissioning, case-specific routine QA needed for a methodical introduction

Language: Английский

---