Strategies for Pre-training Graph Neural Networks DOI Creative Commons
Weihua Hu, Bowen Liu, Joseph Gomes

и другие.

arXiv (Cornell University), Год журнала: 2019, Номер unknown

Опубликована: Янв. 1, 2019

Many applications of machine learning require a model to make accurate pre-dictions on test examples that are distributionally different from training ones, while task-specific labels scarce during training. An effective approach this challenge is pre-train related tasks where data abundant, and then fine-tune it downstream task interest. While pre-training has been in many language vision domains, remains an open question how effectively use graph datasets. In paper, we develop new strategy self-supervised methods for Graph Neural Networks (GNNs). The key the success our expressive GNN at level individual nodes as well entire graphs so can learn useful local global representations simultaneously. We systematically study multiple classification find naive strategies, which GNNs either or nodes, give limited improvement even lead negative transfer tasks. contrast, avoids improves generalization significantly across tasks, leading up 9.4% absolute improvements ROC-AUC over non-pre-trained models achieving state-of-the-art performance molecular property prediction protein function prediction.

Язык: Английский

Review of deep learning: concepts, CNN architectures, challenges, applications, future directions DOI Creative Commons
Laith Alzubaidi, Jinglan Zhang, Amjad J. Humaidi

и другие.

Journal Of Big Data, Год журнала: 2021, Номер 8(1)

Опубликована: Март 31, 2021

In the last few years, deep learning (DL) computing paradigm has been deemed Gold Standard in machine (ML) community. Moreover, it gradually become most widely used computational approach field of ML, thus achieving outstanding results on several complex cognitive tasks, matching or even beating those provided by human performance. One benefits DL is ability to learn massive amounts data. The grown fast years and extensively successfully address a wide range traditional applications. More importantly, outperformed well-known ML techniques many domains, e.g., cybersecurity, natural language processing, bioinformatics, robotics control, medical information among others. Despite contributed works reviewing State-of-the-Art DL, all them only tackled one aspect which leads an overall lack knowledge about it. Therefore, this contribution, we propose using more holistic order provide suitable starting point from develop full understanding DL. Specifically, review attempts comprehensive survey important aspects including enhancements recently added field. particular, paper outlines importance presents types networks. It then convolutional neural networks (CNNs) utilized network type describes development CNNs architectures together with their main features, AlexNet closing High-Resolution (HR.Net). Finally, further present challenges suggested solutions help researchers understand existing research gaps. followed list major Computational tools FPGA, GPU, CPU are summarized along description influence ends evolution matrix, benchmark datasets, summary conclusion.

Язык: Английский

Процитировано

4978

Artificial intelligence in healthcare DOI
Kun‐Hsing Yu, Andrew L. Beam, Isaac S. Kohane

и другие.

Nature Biomedical Engineering, Год журнала: 2018, Номер 2(10), С. 719 - 731

Опубликована: Окт. 5, 2018

Язык: Английский

Процитировано

2111

CellProfiler 3.0: Next-generation image processing for biology DOI Creative Commons

Claire McQuin,

Allen Goodman, Vasiliy S. Chernyshev

и другие.

PLoS Biology, Год журнала: 2018, Номер 16(7), С. e2005970 - e2005970

Опубликована: Июль 3, 2018

CellProfiler has enabled the scientific research community to create flexible, modular image analysis pipelines since its release in 2005. Here, we describe 3.0, a new version of software supporting both whole-volume and plane-wise three-dimensional (3D) stacks, increasingly common biomedical research. CellProfiler's infrastructure is greatly improved, provide protocol for cloud-based, large-scale processing. New plugins enable running pretrained deep learning models on images. Designed by biologists, equips researchers with powerful computational tools via well-documented user interface, empowering biologists all fields quantitative, reproducible workflows.

Язык: Английский

Процитировано

1908

Albumentations: Fast and Flexible Image Augmentations DOI

Alexander V. Buslaev,

Vladimir Iglovikov, Eugene Khvedchenya

и другие.

Information, Год журнала: 2020, Номер 11(2), С. 125 - 125

Опубликована: Фев. 24, 2020

Data augmentation is a commonly used technique for increasing both the size and diversity of labeled training sets by leveraging input transformations that preserve corresponding output labels. In computer vision, image augmentations have become common implicit regularization to combat overfitting in deep learning models are ubiquitously improve performance. While most frameworks implement basic transformations, list typically limited some variations flipping, rotating, scaling, cropping. Moreover, processing speed varies existing libraries. We present Albumentations, fast flexible open source library with many various transform operations available also an easy-to-use wrapper around other discuss design principles drove implementation Albumentations give overview key features distinct capabilities. Finally, we provide examples different vision tasks demonstrate faster than tools on operations.

Язык: Английский

Процитировано

1908

The rise of deep learning in drug discovery DOI Creative Commons
Hongming Chen, Ola Engkvist, Yinhai Wang

и другие.

Drug Discovery Today, Год журнала: 2018, Номер 23(6), С. 1241 - 1250

Опубликована: Янв. 31, 2018

Over the past decade, deep learning has achieved remarkable success in various artificial intelligence research areas. Evolved from previous on neural networks, this technology shown superior performance to other machine algorithms areas such as image and voice recognition, natural language processing, among others. The first wave of applications pharmaceutical emerged recent years, its utility gone beyond bioactivity predictions promise addressing diverse problems drug discovery. Examples will be discussed covering prediction, de novo molecular design, synthesis prediction biological analysis.

Язык: Английский

Процитировано

1488

Generating Focused Molecule Libraries for Drug Discovery with Recurrent Neural Networks DOI Creative Commons
Marwin Segler,

Thierry Kogej,

Christian Tyrchan

и другие.

ACS Central Science, Год журнала: 2017, Номер 4(1), С. 120 - 131

Опубликована: Дек. 28, 2017

In

Язык: Английский

Процитировано

1446

A guide to machine learning for biologists DOI
Joe G. Greener, Shaun M. Kandathil, Lewis Moffat

и другие.

Nature Reviews Molecular Cell Biology, Год журнала: 2021, Номер 23(1), С. 40 - 55

Опубликована: Сен. 13, 2021

Язык: Английский

Процитировано

1309

Artificial intelligence in digital pathology — new tools for diagnosis and precision oncology DOI
Kaustav Bera, Kurt A. Schalper, David L. Rimm

и другие.

Nature Reviews Clinical Oncology, Год журнала: 2019, Номер 16(11), С. 703 - 715

Опубликована: Авг. 9, 2019

Язык: Английский

Процитировано

1176

A deep learning algorithm using CT images to screen for Corona virus disease (COVID-19) DOI Creative Commons
Shuai Wang, Bo-Kyeong Kang,

Jinlu Ma

и другие.

European Radiology, Год журнала: 2021, Номер 31(8), С. 6096 - 6104

Опубликована: Фев. 24, 2021

Abstract Objective The outbreak of Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-COV-2) has caused more than 26 million cases Corona virus disease (COVID-19) in the world so far. To control spread disease, screening large numbers suspected for appropriate quarantine and treatment are a priority. Pathogenic laboratory testing is typically gold standard, but it bears burden significant false negativity, adding to urgent need alternative diagnostic methods combat disease. Based on COVID-19 radiographic changes CT images, this study hypothesized that artificial intelligence might be able extract specific graphical features provide clinical diagnosis ahead pathogenic test, thus saving critical time control. Methods We collected 1065 images pathogen-confirmed along with those previously diagnosed typical viral pneumonia. modified inception transfer-learning model establish algorithm, followed by internal external validation. Results validation achieved total accuracy 89.5% specificity 0.88 sensitivity 0.87. dataset showed 79.3% 0.83 0.67. In addition, 54 first two nucleic acid test results were negative, 46 predicted as positive an 85.2%. Conclusion These demonstrate proof-of-principle using radiological timely accurate diagnosis. Key Points • evaluated performance deep learning algorithm screen during influenza season. As method, our relatively high image datasets. was used distinguish between other pneumonia, both which have quite similar radiologic characteristics.

Язык: Английский

Процитировано

1034

A deep learning algorithm using CT images to screen for Corona Virus Disease (COVID-19) DOI Open Access
Shuai Wang, Bo-Kyeong Kang,

Jinlu Ma

и другие.

medRxiv (Cold Spring Harbor Laboratory), Год журнала: 2020, Номер unknown

Опубликована: Фев. 17, 2020

Abstract Background The outbreak of Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-COV-2) has caused more than 2.5 million cases Corona Virus Disease (COVID-19) in the world so far, with that number continuing to grow. To control spread disease, screening large numbers suspected for appropriate quarantine and treatment is a priority. Pathogenic laboratory testing gold standard but time-consuming significant false negative results. Therefore, alternative diagnostic methods are urgently needed combat disease. Based on COVID-19 radiographical changes CT images, we hypothesized Artificial Intelligence’s deep learning might be able extract COVID-19’s specific graphical features provide clinical diagnosis ahead pathogenic test, thus saving critical time disease control. Methods Findings We collected 1,065 images pathogen-confirmed (325 images) along those previously diagnosed typical viral pneumonia (740 images). modified Inception transfer-learning model establish algorithm, followed by internal external validation. validation achieved total accuracy 89.5% specificity 0.88 sensitivity 0.87. dataset showed 79.3% 0.83 0.67. In addition, 54 first two nucleic acid test results were negative, 46 predicted as positive 85.2%. Conclusion These demonstrate proof-of-principle using artificial intelligence radiological timely accurate diagnosis. Author summary COVID-19, measures time. pneumonia. algorithm. Our study represents apply effectively COVID-19.

Язык: Английский

Процитировано

996