Denoising for Photon-limited Imaging via a Multi-level Pyramid Network DOI

Shansi Zhang,

Edmund Y. Lam

TENCON 2021 - 2021 IEEE Region 10 Conference (TENCON), Год журнала: 2022, Номер unknown, С. 1 - 6

Опубликована: Ноя. 1, 2022

Imaging under photon-scarce situations introduces challenges to many applications as the captured images are with low signal-to-noise ratio. Here, we target on denoising photon-limited imaging. We develop a multi-level pyramid network (MPDNet), which employs idea of Laplacian learn small-scale noise map and larger-scale high-frequency details at different levels. Feature extractions conducted multi-scale input encode richer contextual information. The major component MPDNet is multi-skip attention residual block, integrates feature fusion mechanism for better representation. Experimental results have demonstrated that our can achieve superior performance photon counts.

Язык: Английский

A Deep Retinex Framework for Light Field Restoration under Low-light Conditions DOI

Shansi Zhang,

Edmund Y. Lam

2022 26th International Conference on Pattern Recognition (ICPR), Год журнала: 2022, Номер unknown

Опубликована: Авг. 21, 2022

Light field (LF) images can record the scene from multiple directions and have many applications, such as refocusing depth estimation. However, these applications be heavily influenced by poor light condition noise. This work aims to recover high-quality LF their lowlight detection. First, a decomposition network is employed decompose each image into its reflectance illumination with Retinex theory. Then, two enhancement networks are designed denoise enhance illumination, respectively. They adopt alternate spatial-angular feature extractions process all views synchronously high efficiency. A parallel dual attention mechanism integrated both spatial angular extractions, encode more important information. Moreover, discriminator introduced during training generate realistic making judgment according characteristics. Experimental results demonstrated superior performance of our method, which restore content, luminance, color geometric structures effectively.

Язык: Английский

Процитировано

4

EAT: epipolar-aware Transformer for low-light light field enhancement DOI
Xingzheng Wang, Wenhao Huang, Kaiqiang Chen

и другие.

Multimedia Tools and Applications, Год журнала: 2024, Номер unknown

Опубликована: Май 17, 2024

Язык: Английский

Процитировано

0

基于深度学习的光场图像重建与增强综述(特邀) DOI

肖泽宇 Xiao Zeyu,

熊志伟 Xiong Zhiwei,

王立志 Wang Lizhi

и другие.

Laser & Optoelectronics Progress, Год журнала: 2024, Номер 61(16), С. 1611015 - 1611015

Опубликована: Янв. 1, 2024

Процитировано

0

An Effective Image Restorer: Denoising and Luminance Adjustment for Low-photon-count Imaging DOI Creative Commons

Shansi Zhang,

Edmund Y. Lam

arXiv (Cornell University), Год журнала: 2021, Номер unknown

Опубликована: Янв. 1, 2021

Imaging under photon-scarce situations introduces challenges to many applications as the captured images are with low signal-to-noise ratio and poor luminance. In this paper, we investigate raw image restoration low-photon-count conditions by simulating imaging of quanta sensor (QIS). We develop a lightweight framework, which consists multi-level pyramid denoising network (MPDNet) luminance adjustment (LA) module achieve separate enhancement. The main component our framework is multi-skip attention residual block (MARB), integrates multi-scale feature fusion mechanism for better representation. Our MPDNet adopts idea Laplacian learn small-scale noise map larger-scale high-frequency details at different levels, extractions conducted on input encode richer contextual information. LA enhances denoised estimating its illumination, can avoid color distortion. Extensive experimental results have demonstrated that restorer superior performance degraded various photon levels suppressing recovering effectively.

Язык: Английский

Процитировано

1

Unsupervised Light Field Depth Estimation via Multi-view Feature Matching with Occlusion Prediction DOI Creative Commons

Shansi Zhang,

Nan Meng, Edmund Y. Lam

и другие.

arXiv (Cornell University), Год журнала: 2023, Номер unknown

Опубликована: Янв. 1, 2023

Depth estimation from light field (LF) images is a fundamental step for numerous applications. Recently, learning-based methods have achieved higher accuracy and efficiency than the traditional methods. However, it costly to obtain sufficient depth labels supervised training. In this paper, we propose an unsupervised framework estimate LF images. First, design disparity network (DispNet) with coarse-to-fine structure predict maps different view combinations. It explicitly performs multi-view feature matching learn correspondences effectively. As occlusions may cause violation of photo-consistency, introduce occlusion prediction (OccNet) maps, which are used as element-wise weights photometric loss solve issue assist learning. With estimated by multiple input combinations, then fusion strategy based on errors effective handling final map accuracy. Experimental results demonstrate that our method achieves superior performance both dense sparse images, also shows better robustness generalization real-world compared other

Язык: Английский

Процитировано

0

Denoising for Photon-limited Imaging via a Multi-level Pyramid Network DOI

Shansi Zhang,

Edmund Y. Lam

TENCON 2021 - 2021 IEEE Region 10 Conference (TENCON), Год журнала: 2022, Номер unknown, С. 1 - 6

Опубликована: Ноя. 1, 2022

Imaging under photon-scarce situations introduces challenges to many applications as the captured images are with low signal-to-noise ratio. Here, we target on denoising photon-limited imaging. We develop a multi-level pyramid network (MPDNet), which employs idea of Laplacian learn small-scale noise map and larger-scale high-frequency details at different levels. Feature extractions conducted multi-scale input encode richer contextual information. The major component MPDNet is multi-skip attention residual block, integrates feature fusion mechanism for better representation. Experimental results have demonstrated that our can achieve superior performance photon counts.

Язык: Английский

Процитировано

0