Liquid lens based holographic camera for real 3D scene hologram acquisition using end-to-end physical model-driven network

Light Science & Applications, Год журнала: 2024, Номер 13(1)

Опубликована: Фев. 29, 2024

Abstract With the development of artificial intelligence, neural network provides unique opportunities for holography, such as high fidelity and dynamic calculation. How to obtain real 3D scene generate hologram in time is an urgent problem. Here, we propose a liquid lens based holographic camera acquisition using end-to-end physical model-driven (EEPMD-Net). As core component camera, first 10 mm large aperture electrowetting-based proposed by specially fabricated solution. The design ensures that multi-layers can be obtained quickly with great imaging performance. EEPMD-Net takes information input, uses two new structures encoder decoder networks realize low-noise phase generation. By comparing intensity between reconstructed image after depth fusion target scene, composite loss function constructed optimization, high-fidelity training true realized time. achieves fast generation experiment proves has advantage low noise. used display, measurement, encryption other fields.

Язык: Английский

---

Adaptive multiscale microscope with fast zooming, extended working distance, and large field of view

Deleted Journal, Год журнала: 2024, Номер 5(1), С. 1 - 1

Опубликована: Янв. 1, 2024

The field-of-view (FOV), depth of field, and resolution conventional microscopes are constrained by each other; therefore, a zoom function is required. Traditional methods lose real-time performance have limited information throughput, severely limiting their application, especially in three-dimensional dynamic imaging large-amount or large-size sample scanning. Here, an adaptive multiscale (AMS) mechanism combining the benefits liquid lenses techniques proposed to realize functions fast zooming, wide working distance (WD) range large FOV on self-developed AMS microscope. design principles were revealed. Moreover, nonuniform-distortion-correction algorithm composite patching designed improve image quality. continuous tunable magnification microscope from 9× 18×, with corresponding diameters ranging 2.31 0.98 mm 161 287 line-pairs/mm, respectively. extended WD 0.8 response time 38 ms. Experiments demonstrated advantages pathological scanning, thick-sample imaging, microfluidic process monitoring, observation living microorganisms. first step towards technology expected be applied life sciences, medical diagnosis, industrial detection.

Язык: Английский

---

A Survey of the Real-Time Metaverse: Challenges and Opportunities

Future Internet, Год журнала: 2024, Номер 16(10), С. 379 - 379

Опубликована: Окт. 18, 2024

The metaverse concept has been evolving from static, pre-rendered virtual environments to a new frontier: the real-time metaverse. This survey paper explores emerging field of technologies, which enable continuous integration dynamic, real-world data into immersive environments. We examine key technologies driving this evolution, including advanced sensor systems (LiDAR, radar, cameras), artificial intelligence (AI) models for interpretation, fast fusion algorithms, and edge computing with 5G networks low-latency transmission. reveals how these are orchestrated achieve near-instantaneous synchronization between physical worlds, defining characteristic that distinguishes its traditional counterparts. provides comprehensive insight technical challenges discusses solutions realize responsive dynamic potential applications impact across various fields considered, live entertainment, remote collaboration, simulations, urban planning digital twins. By synthesizing current research identifying future directions, foundation understanding advancing rapidly landscape contributing growing body knowledge on experiences setting stage further innovations in Metaverse transformative field.

Язык: Английский

---

Geometric transformation adaptive optics (GTAO) for volumetric deep brain imaging through gradient-index lenses

Nature Communications, Год журнала: 2024, Номер 15(1)

Опубликована: Фев. 3, 2024

Abstract The advance of genetic function indicators has enabled the observation neuronal activities at single-cell resolutions. A major challenge for applications on mammalian brains is limited optical access depth. Currently, method choice to deep brain structures insert miniature components. Among these validated optics, gradient-index (GRIN) lens been widely employed its compactness and simplicity. However, due strong fourth-order astigmatism, GRIN lenses suffer from a small imaging field view, which severely limits measurement throughput success rate. To overcome challenges, we developed geometric transformation adaptive optics (GTAO), enables adaptable achromatic large-volume correction through lenses. We demonstrate advances in vivo structural functional mouse brains. results suggest that GTAO can serve as versatile solution enable recording

Язык: Английский

---

Deep-learning-augmented computational miniature mesoscope

Optica, Год журнала: 2022, Номер 9(9), С. 1009 - 1009

Опубликована: Авг. 3, 2022

Fluorescence microscopy is essential to study biological structures and dynamics. However, existing systems suffer from a tradeoff between field-of-view (FOV), resolution, complexity, thus cannot fulfill the emerging need of miniaturized platforms providing micron-scale resolution across centimeter-scale FOVs. To overcome this challenge, we developed Computational Miniature Mesoscope (CM$^2$) that exploits computational imaging strategy enable single-shot 3D high-resolution wide FOV in platform. Here, present CM$^2$ V2 significantly advances both hardware computation. We complement 3$\times$3 microlens array with new hybrid emission filter improves contrast by 5$\times$, design 3D-printed freeform collimator for LED illuminator excitation efficiency 3$\times$. reconstruction large volume, develop an accurate efficient linear shift-variant (LSV) model characterizes spatially varying aberrations. then train multi-module deep learning model, CM$^2$Net, using only 3D-LSV simulator. show CM$^2$Net generalizes well experiments achieves $\sim$7-mm 800-$\mu$m depth, provides $\sim$6-$\mu$m lateral $\sim$25-$\mu$m axial resolution. This $\sim$8$\times$ better localization $\sim$1400$\times$ faster speed as compared previous model-based algorithm. anticipate simple low-cost miniature system will be impactful many large-scale fluorescence applications.

Язык: Английский

---

Neurophotonic Tools for Microscopic Measurements and Manipulation: Status Report

Neurophotonics, Год журнала: 2022, Номер 9(S1)

Опубликована: Апрель 27, 2022

Neurophotonics was launched in 2014 coinciding with the launch of BRAIN Initiative focused on development technologies for advancement neuroscience. For last seven years, Neurophotonics' agenda has been well aligned this focus neurotechnologies featuring new optical methods and tools applicable to brain studies. While 2.0 is pivoting towards applications these novel quest understand brain, article we review an extensive diverse toolkit explore function that have emerged from related large-scale efforts measurement manipulation structure function. Here, neurophotonic mostly animal A companion article, scheduled appear later year, will cover diffuse imaging noninvasive human each domain, outline current state-of-the-art respective technologies, identify areas where innovation needed provide outlook future directions.

Язык: Английский

---

Large depth-of-field ultra-compact microscope by progressive optimization and deep learning

Nature Communications, Год журнала: 2023, Номер 14(1)

Опубликована: Июль 11, 2023

The optical microscope is customarily an instrument of substantial size and expense but limited performance. Here we report integrated that achieves performance beyond a commercial with 5×, NA 0.1 objective only at 0.15 cm3 0.5 g, whose five orders magnitude smaller than conventional microscope. To achieve this, progressive optimization pipeline proposed which systematically optimizes both aspherical lenses diffractive elements over 30 times memory reduction compared to the end-to-end optimization. By designing simulation-supervision deep neural network for spatially varying deconvolution during design, accomplish 10 improvement in depth-of-field traditional microscopes great generalization wide variety samples. show unique advantages, equipped cell phone without any accessories application portable diagnostics. We believe our method provides new framework design miniaturized high-performance imaging systems by integrating optics, computational learning.

Язык: Английский

---

Mesoscopic calcium imaging in a head-unrestrained male non-human primate using a lensless microscope

Nature Communications, Год журнала: 2024, Номер 15(1)

Опубликована: Фев. 10, 2024

Mesoscopic calcium imaging enables studies of cell-type specific neural activity over large areas. A growing body literature suggests that can be different when animals are free to move compared they restrained. Unfortunately, existing systems for dynamics areas in non-human primates (NHPs) table-top devices require restraint the animal's head. Here, we demonstrate an device capable mesoscale a head-unrestrained male primate. We successfully miniaturize our system by replacing lenses with optical mask and computational algorithms. The resulting lensless microscope fit comfortably on NHP, allowing its head freely while imaging. able measure orientation columns maps 20 mm2 field-of-view macaque. Our work establishes mesoscopic using as powerful approach studying under more naturalistic conditions.

Язык: Английский

---

Hippocampal place cell remapping occurs with memory storage of aversive experiences

eLife, Год журнала: 2023, Номер 12

Опубликована: Июль 19, 2023

Aversive stimuli can cause hippocampal place cells to remap their firing fields, but it is not known whether remapping plays a role in storing memories of aversive experiences. Here, we addressed this question by performing vivo calcium imaging CA1 freely behaving rats (n = 14). Rats were first trained prefer short path over long for obtaining food reward, then avoid the delivering mild footshock. Remapping was assessed comparing cell population vector similarity before acquisition versus after extinction avoidance. Some received shock systemic injections amnestic drug scopolamine at dose (1 mg/kg) that impaired avoidance learning spared spatial tuning and shock-evoked responses neurons. Place remapped significantly more following remembered than forgotten shocks (drug-free conditions); shock-induced did fields migrate toward or away from shocked location similarly prevalent responsive non-responsive shocks. When exposed neutral barrier rather shock, less response barrier. We conclude occurs events are merely perceived forgotten, suggesting reorganization codes may play events.The human brain able remember experiences occurred specific places times, such as birthday party held particular restaurant. A part hippocampus helps store these episodic memories, how exactly fully understood. Within specialized neurons which ‘label’ locations with unique patterns activity. revisit place, restaurant, recall stored pattern activity allowing us recognize familiar location. It has been shown new negative experience – example, if went back restaurant had terrible meal triggers update label associated However, remains uncertain re-labelling assists memory unpleasant experience. To investigate, Blair et al. used technique monitor moving rats. The given foot previously explored Tiny cameras attached heads record hundreds shock. Initially, avoided where they shocked. Over time, began return location; however, displayed different compared previous visits test change corresponded another group administered amnesia-inducing causing them forget These site show any changes when revisited it. findings imply alter only event remembered, forgotten. This indicates alterations Having better understanding could lead treatments diseases impair memory, Alzheimer’s disease age-related dementia.

Язык: Английский

---

Deep-brain optical recording of neural dynamics during behavior

Neuron, Год журнала: 2023, Номер 111(23), С. 3716 - 3738

Опубликована: Окт. 6, 2023

Язык: Английский

---