Showing 1–27 of 27 results for author: Barbastathis, G

Sensitivity fields and parameter estimation from dielectric objects

Authors: George Barbastathis

Abstract: The quantitative phase image formation process is posed as a problem of parameter estimation from intensity measurements. This approach is inclusive of traditional pixel-oriented imaging, where the sought parameters are the pixel values. The resulting optimization process to find the parameters is then seen to depend on the Sensitivity Field: this is the gradient of the scattered field with respec… ▽ More The quantitative phase image formation process is posed as a problem of parameter estimation from intensity measurements. This approach is inclusive of traditional pixel-oriented imaging, where the sought parameters are the pixel values. The resulting optimization process to find the parameters is then seen to depend on the Sensitivity Field: this is the gradient of the scattered field with respect to the parameters, and it turns out to obey a scattering relationship that is analogous to that of the original scattered field. Examples are given from several regimes of scattering strength. △ Less

Submitted 30 June, 2024; originally announced July 2024.

On the use of deep learning for phase recovery

Authors: Kaiqiang Wang, Li Song, Chutian Wang, Zhenbo Ren, Guangyuan Zhao, Jiazhen Dou, Jianglei Di, George Barbastathis, Renjie Zhou, Jianlin Zhao, Edmund Y. Lam

Abstract: Phase recovery (PR) refers to calculating the phase of the light field from its intensity measurements. As exemplified from quantitative phase imaging and coherent diffraction imaging to adaptive optics, PR is essential for reconstructing the refractive index distribution or topography of an object and correcting the aberration of an imaging system. In recent years, deep learning (DL), often imple… ▽ More Phase recovery (PR) refers to calculating the phase of the light field from its intensity measurements. As exemplified from quantitative phase imaging and coherent diffraction imaging to adaptive optics, PR is essential for reconstructing the refractive index distribution or topography of an object and correcting the aberration of an imaging system. In recent years, deep learning (DL), often implemented through deep neural networks, has provided unprecedented support for computational imaging, leading to more efficient solutions for various PR problems. In this review, we first briefly introduce conventional methods for PR. Then, we review how DL provides support for PR from the following three stages, namely, pre-processing, in-processing, and post-processing. We also review how DL is used in phase image processing. Finally, we summarize the work in DL for PR and outlook on how to better use DL to improve the reliability and efficiency in PR. Furthermore, we present a live-updating resource (https://github.com/kqwang/phase-recovery) for readers to learn more about PR. △ Less

Submitted 2 August, 2023; originally announced August 2023.

Comments: 82 pages, 32 figures

Journal ref: Light: Science & Applications 13, 4 (2024)

Accelerated deep self-supervised ptycho-laminography for three-dimensional nanoscale imaging of integrated circuits

Authors: Iksung Kang, Yi Jiang, Mirko Holler, Manuel Guizar-Sicairos, A. F. J. Levi, Jeffrey Klug, Stefan Vogt, George Barbastathis

Abstract: Three-dimensional inspection of nanostructures such as integrated circuits is important for security and reliability assurance. Two scanning operations are required: ptychographic to recover the complex transmissivity of the specimen; and rotation of the specimen to acquire multiple projections covering the 3D spatial frequency domain. Two types of rotational scanning are possible: tomographic and… ▽ More Three-dimensional inspection of nanostructures such as integrated circuits is important for security and reliability assurance. Two scanning operations are required: ptychographic to recover the complex transmissivity of the specimen; and rotation of the specimen to acquire multiple projections covering the 3D spatial frequency domain. Two types of rotational scanning are possible: tomographic and laminographic. For flat, extended samples, for which the full 180 degree coverage is not possible, the latter is preferable because it provides better coverage of the 3D spatial frequency domain compared to limited-angle tomography. It is also because the amount of attenuation through the sample is approximately the same for all projections. However, both techniques are time consuming because of extensive acquisition and computation time. Here, we demonstrate the acceleration of ptycho-laminographic reconstruction of integrated circuits with 16-times fewer angular samples and 4.67-times faster computation by using a physics-regularized deep self-supervised learning architecture. We check the fidelity of our reconstruction against a densely sampled reconstruction that uses full scanning and no learning. As already reported elsewhere [Zhou and Horstmeyer, Opt. Express, 28(9), pp. 12872-12896], we observe improvement of reconstruction quality even over the densely sampled reconstruction, due to the ability of the self-supervised learning kernel to fill the missing cone. △ Less

Submitted 10 April, 2023; originally announced April 2023.

Comments: 13 pages, 5 figures, 1 table

Attentional Ptycho-Tomography (APT) for three-dimensional nanoscale X-ray imaging with minimal data acquisition and computation time

Authors: Iksung Kang, Ziling Wu, Yi Jiang, Yudong Yao, Junjing Deng, Jeffrey Klug, Stefan Vogt, George Barbastathis

Abstract: Noninvasive X-ray imaging of nanoscale three-dimensional objects, e.g. integrated circuits (ICs), generally requires two types of scanning: ptychographic, which is translational and returns estimates of complex electromagnetic field through ICs; and tomographic scanning, which collects complex field projections from multiple angles. Here, we present Attentional Ptycho-Tomography (APT), an approach… ▽ More Noninvasive X-ray imaging of nanoscale three-dimensional objects, e.g. integrated circuits (ICs), generally requires two types of scanning: ptychographic, which is translational and returns estimates of complex electromagnetic field through ICs; and tomographic scanning, which collects complex field projections from multiple angles. Here, we present Attentional Ptycho-Tomography (APT), an approach trained to provide accurate reconstructions of ICs despite incomplete measurements, using a dramatically reduced amount of angular scanning. Training process includes regularizing priors based on typical IC patterns and the physics of X-ray propagation. We demonstrate that APT with 12-time reduced angles achieves fidelity comparable to the gold standard with the original set of angles. With the same set of reduced angles, APT also outperforms baseline reconstruction methods. In our experiments, APT achieves 108-time aggregate reduction in data acquisition and computation without compromising quality. We expect our physics-assisted machine learning framework could also be applied to other branches of nanoscale imaging. △ Less

Submitted 29 November, 2022; originally announced December 2022.

Comments: 27 pages, 7 figures

Extracting particle size distribution from laser speckle with a physics-enhanced autocorrelation-based estimator (PEACE)

Authors: Qihang Zhang, Janaka C. Gamekkanda, Ajinkya Pandit, Wenlong Tang, Charles Papageorgiou, Chris Mitchell, Yihui Yang, Michael Schwaerzler, Tolutola Oyetunde, Richard D. Braatz, Allan S. Myerson, George Barbastathis

Abstract: Extracting quantitative information about highly scattering surfaces from an imaging system is challenging because the phase of the scattered light undergoes multiple folds upon propagation, resulting in complex speckle patterns. One specific application is the drying of wet powders in the pharmaceutical industry, where quantifying the particle size distribution (PSD) is of particular interest. A… ▽ More Extracting quantitative information about highly scattering surfaces from an imaging system is challenging because the phase of the scattered light undergoes multiple folds upon propagation, resulting in complex speckle patterns. One specific application is the drying of wet powders in the pharmaceutical industry, where quantifying the particle size distribution (PSD) is of particular interest. A non-invasive and real-time monitoring probe in the drying process is required, but there is no suitable candidate for this purpose. In this report, we develop a theoretical relationship from the PSD to the speckle image and describe a physics-enhanced autocorrelation-based estimator (PEACE) machine learning algorithm for speckle analysis to measure the PSD of a powder surface. This method solves both the forward and inverse problems together and enjoys increased interpretability, since the machine learning approximator is regularized by the physical law. △ Less

Submitted 2 March, 2023; v1 submitted 20 April, 2022; originally announced April 2022.

Journal ref: Nature Communications 14, Article number: 1159 (2023)

Unified treatment of exact and approximate scalar electromagnetic wave scattering

Authors: Subeen Pang, George Barbastathis

Abstract: Under conditions of strong scattering, a dilemma often arises regarding the best numerical method to use. Main competitors are the Born series, the Beam Propagation Method, and direct solution of the Lippmann-Schwinger equation. However, analytical relationships between the three methods have not yet, to our knowledge, been explicitly stated. Here, we bridge this gap in the literature. In addition… ▽ More Under conditions of strong scattering, a dilemma often arises regarding the best numerical method to use. Main competitors are the Born series, the Beam Propagation Method, and direct solution of the Lippmann-Schwinger equation. However, analytical relationships between the three methods have not yet, to our knowledge, been explicitly stated. Here, we bridge this gap in the literature. In addition to overall insight about aspects of optical scattering that are best numerically captured by each method, our approach allows us to derive approximate error bounds to be expected under various scattering conditions. △ Less

Submitted 16 February, 2022; originally announced February 2022.

Single-frame label-free cell tomography at speed of more than 10,000 volumes per second

Authors: Baoliang Ge, Yanping He, Mo Deng, Md Habibur Rahman, Yijin Wang, Ziling Wu, Chung Hong N. Wong, Michael K. Chan, Yi-Ping Ho, Liting Duan, Zahid Yaqoob, Peter T. C. So, George Barbastathis, Renjie Zhou

Abstract: Three-dimensional (3D) image cytometers may significantly improve the cell analysis accuracy to facilitate biological discoveries and clinical diagnosis, but their development is curbed by the low imaging throughput. Here we report SIngle-frame LAbel-free Cell Tomography (SILACT) with diffraction-limited resolution and unprecedented imaging speed of over 10,000 volumes/second. SILACT is built on a… ▽ More Three-dimensional (3D) image cytometers may significantly improve the cell analysis accuracy to facilitate biological discoveries and clinical diagnosis, but their development is curbed by the low imaging throughput. Here we report SIngle-frame LAbel-free Cell Tomography (SILACT) with diffraction-limited resolution and unprecedented imaging speed of over 10,000 volumes/second. SILACT is built on a unique interferometric microscope with angle-multiplexing illumination and a pre-trained physics-incorporating Deep Neural Network for efficient 3D Refractive Index (RI) reconstruction, from which 3D morphological and biophysical parameters of cells are extracted. With microfluidics and a high-speed camera, SILACT is capable of imaging over 20,000 cells/second and distinguishing different cell species during rapid measurements of large cell quantities, as well as visualizing shear-induced 3D transient deformation of red blood cells on a sub-millisecond scale. △ Less

Submitted 7 February, 2022; originally announced February 2022.

Comments: Baoliang Ge, Yanping He, Mo Deng contributed equally to this work

Machine Learning Regularized Solution of the Lippmann-Schwinger Equation

Authors: Subeen Pang, George Barbastathis

Abstract: Solution of the discretized Lippmann-Schwinger equation in the spatial frequency domain involves the inversion of a linear operator specified by the scattering potential. To regularize this inevitably ill-conditioned problem, we propose a machine learning approach: a recurrent neural network with long short-term memory (LSTM) and with the null space projection of the Lippmann-Schwinger kernel on t… ▽ More Solution of the discretized Lippmann-Schwinger equation in the spatial frequency domain involves the inversion of a linear operator specified by the scattering potential. To regularize this inevitably ill-conditioned problem, we propose a machine learning approach: a recurrent neural network with long short-term memory (LSTM) and with the null space projection of the Lippmann-Schwinger kernel on the recurrence path. The learning method is trained using examples of typical scattering potentials and their corresponding scattered fields. We test the proposed method in two cases: electromagnetic scattering by dielectric objects, and electron scattering by multiple screened Coulomb potentials. In both cases the solutions to test examples, disjoint from the training set, were obtained with fewer iterations and were accurate compared to linear solvers. We also observed surprising generalization ability: in the electromagnetic case, an LSTM trained with random arrangements of dielectric spheres was able to obtain the correct solutions for general topologically similar objects, such as polygons. This suggests that the LSTM successfully incorporates the physics of scattering into the inversion algorithm. △ Less

Submitted 27 October, 2020; originally announced October 2020.

A machine learning aided global diagnostic and comparative tool to assess effect of quarantine control in Covid-19 spread

Authors: Raj Dandekar, Chris Rackauckas, George Barbastathis

Abstract: We have developed a globally applicable diagnostic Covid-19 model by augmenting the classical SIR epidemiological model with a neural network module. Our model does not rely upon previous epidemics like SARS/MERS and all parameters are optimized via machine learning algorithms employed on publicly available Covid-19 data. The model decomposes the contributions to the infection timeseries to analyz… ▽ More We have developed a globally applicable diagnostic Covid-19 model by augmenting the classical SIR epidemiological model with a neural network module. Our model does not rely upon previous epidemics like SARS/MERS and all parameters are optimized via machine learning algorithms employed on publicly available Covid-19 data. The model decomposes the contributions to the infection timeseries to analyze and compare the role of quarantine control policies employed in highly affected regions of Europe, North America, South America and Asia in controlling the spread of the virus. For all continents considered, our results show a generally strong correlation between strengthening of the quarantine controls as learnt by the model and actions taken by the regions' respective governments. Finally, we have hosted our quarantine diagnosis results for the top 70 affected countries worldwide, on a public platform, which can be used for informed decision making by public health officials and researchers alike. △ Less

Submitted 23 July, 2020; originally announced July 2020.

Comments: 21 pages, 16 figures

Limited-angle tomographic reconstruction of dense layered objects by dynamical machine learning

Authors: Iksung Kang, Alexandre Goy, George Barbastathis

Abstract: Limited-angle tomography of strongly scattering quasi-transparent objects is a challenging, highly ill-posed problem with practical implications in medical and biological imaging, manufacturing, automation, and environmental and food security. Regularizing priors are necessary to reduce artifacts by improving the condition of such problems. Recently, it was shown that one effective way to learn th… ▽ More Limited-angle tomography of strongly scattering quasi-transparent objects is a challenging, highly ill-posed problem with practical implications in medical and biological imaging, manufacturing, automation, and environmental and food security. Regularizing priors are necessary to reduce artifacts by improving the condition of such problems. Recently, it was shown that one effective way to learn the priors for strongly scattering yet highly structured 3D objects, e.g. layered and Manhattan, is by a static neural network [Goy et al, Proc. Natl. Acad. Sci. 116, 19848-19856 (2019)]. Here, we present a radically different approach where the collection of raw images from multiple angles is viewed analogously to a dynamical system driven by the object-dependent forward scattering operator. The sequence index in angle of illumination plays the role of discrete time in the dynamical system analogy. Thus, the imaging problem turns into a problem of nonlinear system identification, which also suggests dynamical learning as better fit to regularize the reconstructions. We devised a recurrent neural network (RNN) architecture with a novel split-convolutional gated recurrent unit (SC-GRU) as the fundamental building block. Through comprehensive comparison of several quantitative metrics, we show that the dynamic method improves upon previous static approaches with fewer artifacts and better overall reconstruction fidelity. △ Less

Submitted 21 July, 2020; originally announced July 2020.

Comments: 12 pages, 7 figures, 2 tables

Neural Network aided quarantine control model estimation of global Covid-19 spread

Authors: Raj Dandekar, George Barbastathis

Abstract: Since the first recording of what we now call Covid-19 infection in Wuhan, Hubei province, China on Dec 31, 2019, the disease has spread worldwide and met with a wide variety of social distancing and quarantine policies. The effectiveness of these responses is notoriously difficult to quantify as individuals travel, violate policies deliberately or inadvertently, and infect others without themselv… ▽ More Since the first recording of what we now call Covid-19 infection in Wuhan, Hubei province, China on Dec 31, 2019, the disease has spread worldwide and met with a wide variety of social distancing and quarantine policies. The effectiveness of these responses is notoriously difficult to quantify as individuals travel, violate policies deliberately or inadvertently, and infect others without themselves being detected. In this paper, we attempt to interpret and extrapolate from publicly available data using a mixed first-principles epidemiological equations and data-driven neural network model. Leveraging our neural network augmented model, we focus our analysis on four locales: Wuhan, Italy, South Korea and the United States of America, and compare the role played by the quarantine and isolation measures in each of these countries in controlling the effective reproduction number $R_{t}$ of the virus. Our results unequivocally indicate that the countries in which rapid government interventions and strict public health measures for quarantine and isolation were implemented were successful in halting the spread of infection and prevent it from exploding exponentially. We test the predictive ability of our model by matching predictions in the duration 3 March - 1 April 2020 for Wuhan and in the duration 25 March - 1 April 2020 for Italy and South Korea. In the case of the US, our model captures well the current infected curve growth and predicts a halting of infection spread by 20 April 2020. We further demonstrate that relaxing or reversing quarantine measures right now will lead to an exponential explosion in the infected case count, thus nullifying the role played by all measures implemented in the US since mid March 2020. △ Less

Submitted 2 April, 2020; originally announced April 2020.

Comments: 13 pages, 26 figures

Neural Network aided quarantine control model estimation of COVID spread in Wuhan, China

Authors: Raj Dandekar, George Barbastathis

Abstract: In a move described as unprecedented in public health history, starting 24 January 2020, China imposed quarantine and isolation restrictions in Wuhan, a city of more than 10 million people. This raised the question: is mass quarantine and isolation effective as a social tool in addition to its scientific use as a medical tool? In an effort to address this question, using a epidemiological model dr… ▽ More In a move described as unprecedented in public health history, starting 24 January 2020, China imposed quarantine and isolation restrictions in Wuhan, a city of more than 10 million people. This raised the question: is mass quarantine and isolation effective as a social tool in addition to its scientific use as a medical tool? In an effort to address this question, using a epidemiological model driven approach augmented by machine learning, we show that the quarantine and isolation measures implemented in Wuhan brought down the effective reproduction number R(t) of the CoVID-19 spread from R(t) > 1 to R(t) <1 within a month after the imposition of quarantine control measures in Wuhan, China. This ultimately resulted in a stagnation phase in the infected case count in Wuhan. Our results indicate that the strict public health policies implemented in Wuhan may have played a crucial role in halting down the spread of infection and such measures should potentially be implemented in other highly affected countries such as South Korea, Italy and Iran to curtail spread of the disease. Finally, our forecasting results predict a stagnation in the quarantine control measures implemented in Wuhan towards the end of March 2020; this would lead to a subsequent stagnation in the effective reproduction number at R(t) <1. We warn that immediate relaxation of the quarantine measures in Wuhan may lead to a relapse in the infection spread and a subsequent increase in the effective reproduction number to R(t) >1. Thus, it may be wise to relax quarantine measures after sufficient time has elapsed, during which maximum of the quarantined/isolated individuals are recovered. △ Less

Submitted 18 March, 2020; originally announced March 2020.

Comments: 9 pages including references. 8 figures

Scalable additive manufacturing via integral image formation

Authors: Seok Kim, Jordan Jerome Handler, Young Tae Cho, George Barbastathis, Nicholas Xuanlai Fang

Abstract: Additive manufacturing techniques enable the fabrication of functional microstructures with mechanical and chemical properties tailored to their intended use. One common technique is stereolithography, which has recently been augmented in response to modern demands to support smaller features, larger build areas, and/or faster speeds. However, a limitation is that such systems typically utilize a… ▽ More Additive manufacturing techniques enable the fabrication of functional microstructures with mechanical and chemical properties tailored to their intended use. One common technique is stereolithography, which has recently been augmented in response to modern demands to support smaller features, larger build areas, and/or faster speeds. However, a limitation is that such systems typically utilize a single-aperture imaging configuration, which restricts their ability to produce microstructures at large volumes due to the tradeoff between the image resolution and image field area. In this paper, we demonstrate three versatile imaging functions based on the coupling a planar lens array, namely, parallel image transfer, kaleidoscopic superposition, and integral reconstruction, the combination of which is termed integral lithography. In this approach, the individual microlenses in the planar lens array maintain a high numerical aperture and are employed in the creation of digital light patterns that can expand the printable area by the number of microlenses (103-104). The proposed lens array-based integral imaging system provides the concurrent ability to scale-up and scale-down incoming image fields, thereby enabling the scalable stereolithographic fabrication of three-dimensional features that surpass the resolution-to-area scaling limit. The proposed system opens up new possibilities for producing periodic microarchitectures spanning four orders of magnitude from micrometers to centimeters that can be applied to biological scaffolds, metastructures, chemical reactors, and functional surfaces. △ Less

Submitted 10 November, 2019; originally announced November 2019.

High-Resolution Limited-Angle Phase Tomography of Dense Layered Objects Using Deep Neural Networks

Authors: Alexandre Goy, Girish Rughoobur, Shuai Li, Kwabena Arthur, Akintunde I. Akinwande, George Barbastathis

Abstract: We present a Machine Learning-based method for tomographic reconstruction of dense layered objects, with range of projection angles limited to $\pm $10$^\circ$. Whereas previous approaches to phase tomography generally require two steps, first to retrieve phase projections from intensity projections and then perform tomographic reconstruction on the retrieved phase projections, in our work a physi… ▽ More We present a Machine Learning-based method for tomographic reconstruction of dense layered objects, with range of projection angles limited to $\pm $10$^\circ$. Whereas previous approaches to phase tomography generally require two steps, first to retrieve phase projections from intensity projections and then perform tomographic reconstruction on the retrieved phase projections, in our work a physics-informed pre-processor followed by a Deep Neural Network (DNN) conduct the three-dimensional reconstruction directly from the intensity projections. We demonstrate this single-step method experimentally in the visible optical domain on a scaled up integrated circuit phantom. We show that even under conditions of highly attenuated photon fluxes a DNN trained only on synthetic data can be used to successfully reconstruct physical samples disjoint from the synthetic training set. Thus, the need of producing a large number of physical examples for training is ameliorated. The method is generally applicable to tomography with electromagnetic or other types of radiation at all bands. △ Less

Submitted 19 December, 2018; v1 submitted 15 December, 2018; originally announced December 2018.

Comments: 9 pages, 5 figures, 1 table

Spectral pre-modulation of training examples enhances the spatial resolution of the Phase Extraction Neural Network (PhENN)

Authors: Shuai Li, George Barbastathis

Abstract: The Phase Extraction Neural Network (PhENN) is a computational architecture, based on deep machine learning, for lens-less quantitative phase retrieval from raw intensity data. PhENN is a deep convolutional neural network trained through examples consisting of pairs of true phase objects and their corresponding intensity diffraction patterns; thereafter, given a test raw intensity pattern PhENN is… ▽ More The Phase Extraction Neural Network (PhENN) is a computational architecture, based on deep machine learning, for lens-less quantitative phase retrieval from raw intensity data. PhENN is a deep convolutional neural network trained through examples consisting of pairs of true phase objects and their corresponding intensity diffraction patterns; thereafter, given a test raw intensity pattern PhENN is capable of reconstructing the original phase object robustly, in many cases even for objects outside the database where the training examples were drawn from. Here, we show that the spatial frequency content of the training examples is an important factor limiting PhENN's spatial frequency response. For example, if the training database is relatively sparse in high spatial frequencies, as most natural scenes are, PhENN's ability to resolve fine spatial features in test patterns will be correspondingly limited. To combat this issue, we propose "flattening" the power spectral density of the training examples before presenting them to PhENN. For phase objects following the statistics of natural scenes, we demonstrate experimentally that the spectral pre-modulation method enhances the spatial resolution of PhENN by a factor of 2. △ Less

Submitted 29 August, 2018; originally announced August 2018.

Comments: 12 pages, 10 figures

Low Photon Count Phase Retrieval Using Deep Learning

Authors: Alexandre Goy, Kwabena Arthur, Shuai Li, George Barbastathis

Abstract: Imaging systems' performance at low light intensity is affected by shot noise, which becomes increasingly strong as the power of the light source decreases. In this paper we experimentally demonstrate the use of deep neural networks to recover objects illuminated with weak light and demonstrate better performance than with the classical Gerchberg-Saxton phase retrieval algorithm for equivalent sig… ▽ More Imaging systems' performance at low light intensity is affected by shot noise, which becomes increasingly strong as the power of the light source decreases. In this paper we experimentally demonstrate the use of deep neural networks to recover objects illuminated with weak light and demonstrate better performance than with the classical Gerchberg-Saxton phase retrieval algorithm for equivalent signal over noise ratio. Prior knowledge about the object is implicitly contained in the training data set and feature detection is possible for a signal over noise ratio close to one. We apply this principle to a phase retrieval problem and show successful recovery of the object's most salient features with as little as one photon per detector pixel on average in the illumination beam. We also show that the phase reconstruction is significantly improved by training the neural network with an initial estimate of the object, as opposed as training it with the raw intensity measurement. △ Less

Submitted 25 June, 2018; originally announced June 2018.

Comments: 8 pages, 5 figures

Journal ref: Phys. Rev. Lett. 121, 243902 (2018)

Imaging through glass diffusers using densely connected convolutional networks

Authors: Shuai Li, Mo Deng, Justin Lee, Ayan Sinha, George Barbastathis

Abstract: Computational imaging through scatter generally is accomplished by first characterizing the scattering medium so that its forward operator is obtained; and then imposing additional priors in the form of regularizers on the reconstruction functional so as to improve the condition of the originally ill-posed inverse problem. In the functional, the forward operator and regularizer must be entered exp… ▽ More Computational imaging through scatter generally is accomplished by first characterizing the scattering medium so that its forward operator is obtained; and then imposing additional priors in the form of regularizers on the reconstruction functional so as to improve the condition of the originally ill-posed inverse problem. In the functional, the forward operator and regularizer must be entered explicitly or parametrically (e.g. scattering matrices and dictionaries, respectively.) However, the process of determining these representations is often incomplete, prone to errors, or infeasible. Recently, deep learning architectures have been proposed to instead learn both the forward operator and regularizer through examples. Here, we propose for the first time, to our knowledge, a convolutional neural network architecture called "IDiffNet" for the problem of imaging through diffuse media and demonstrate that IDiffNet has superior generalization capability through extensive tests with well-calibrated diffusers. We found that the Negative Pearson Correlation Coefficient loss function for training is more appropriate for spatially sparse objects and strong scattering conditions. Our results show that the convolutional architecture is robust to the choice of prior, as demonstrated by the use of multiple training and testing object databases, and capable of achieving higher space-bandwidth product reconstructions than previously reported. △ Less

Submitted 17 November, 2017; originally announced November 2017.

Coherence retrieval using trace regularization

Authors: Chenglong Bao, George Barbastathis, Hui Ji, Zuowei Shen, Zhengyun Zhang

Abstract: The mutual intensity and its equivalent phase-space representations quantify an optical field's state of coherence and are important tools in the study of light propagation and dynamics, but they can only be estimated indirectly from measurements through a process called coherence retrieval, otherwise known as phase-space tomography. As practical considerations often rule out the availability of a… ▽ More The mutual intensity and its equivalent phase-space representations quantify an optical field's state of coherence and are important tools in the study of light propagation and dynamics, but they can only be estimated indirectly from measurements through a process called coherence retrieval, otherwise known as phase-space tomography. As practical considerations often rule out the availability of a complete set of measurements, coherence retrieval is usually a challenging high-dimensional ill-posed inverse problem. In this paper, we propose a trace-regularized optimization model for coherence retrieval and a provably-convergent adaptive accelerated proximal gradient algorithm for solving the resulting problem. Applying our model and algorithm to both simulated and experimental data, we demonstrate an improvement in reconstruction quality over previous models as well as an increase in convergence speed compared to existing first-order methods. △ Less

Submitted 14 November, 2017; v1 submitted 13 June, 2017; originally announced June 2017.

Comments: 28 pages, 10 figures, accepted for publication in SIAM Journal on Imaging Sciences

Lensless computational imaging through deep learning

Authors: Ayan Sinha, Justin Lee, Shuai Li, George Barbastathis

Abstract: Deep learning has been proven to yield reliably generalizable answers to numerous classification and decision tasks. Here, we demonstrate for the first time, to our knowledge, that deep neural networks (DNNs) can be trained to solve inverse problems in computational imaging. We experimentally demonstrate a lens-less imaging system where a DNN was trained to recover a phase object given a raw inten… ▽ More Deep learning has been proven to yield reliably generalizable answers to numerous classification and decision tasks. Here, we demonstrate for the first time, to our knowledge, that deep neural networks (DNNs) can be trained to solve inverse problems in computational imaging. We experimentally demonstrate a lens-less imaging system where a DNN was trained to recover a phase object given a raw intensity image recorded some distance away. △ Less

Submitted 26 June, 2017; v1 submitted 22 February, 2017; originally announced February 2017.

Comments: 8 pages, 13 figures

Tapered Simplified Modal Method for Analysis of Non-rectangular Gratings

Authors: Shuai Li, Changhe Zhou, George Barbastathis

Abstract: The Simplified Modal Method (SMM) provides a quick and intuitive way to analyze the performance of gratings of rectangular shapes. For non-rectangular shapes, a version of SMM has been developed, but it applies only to the Littrow-mounting incidence case and it neglects reflection. Here, we use the theory of mode-coupling in a tapered waveguide to improve SMM so that it applies to non-rectangular… ▽ More The Simplified Modal Method (SMM) provides a quick and intuitive way to analyze the performance of gratings of rectangular shapes. For non-rectangular shapes, a version of SMM has been developed, but it applies only to the Littrow-mounting incidence case and it neglects reflection. Here, we use the theory of mode-coupling in a tapered waveguide to improve SMM so that it applies to non-rectangular gratings at arbitrary angles of incidence. Moreover, this new 'Tapered Simplified Modal Method' (TSMM) allows us to properly account for reflected light. We present here the analytical development of the theory and numerical simulations, demonstrating the validity of the method. △ Less

Submitted 9 June, 2016; originally announced June 2016.

Comments: 13 pages, 8 figures

Hamiltonian and Phase-Space Representation of Spatial Solitons

Authors: Hanhong Gao, Lei Tian, George Barbastathis

Abstract: We use Hamiltonian ray tracing and phase-space representation to describe the propagation of a single spatial soliton and soliton collisions in a Kerr nonlinear medium. Hamiltonian ray tracing is applied using the iterative nonlinear beam propagation method, which allows taking both wave effects and Kerr nonlinearity into consideration. Energy evolution within a single spatial soliton and the exch… ▽ More We use Hamiltonian ray tracing and phase-space representation to describe the propagation of a single spatial soliton and soliton collisions in a Kerr nonlinear medium. Hamiltonian ray tracing is applied using the iterative nonlinear beam propagation method, which allows taking both wave effects and Kerr nonlinearity into consideration. Energy evolution within a single spatial soliton and the exchange of energy when two solitons collide are interpreted intuitively by ray trajectories and geometrical shearing of the Wigner distribution functions. △ Less

Submitted 19 August, 2013; originally announced August 2013.

Comments: 12 pages, 5 figures

Compressive X-ray phase tomography based on the transport of intensity equation

Authors: Lei Tian, Jonathan C. Petruccelli, Qin Miao, Haris Kudrolli, Vivek Nagarkar, George Barbastathis

Abstract: We develop and implement a compressive reconstruction method for tomographic recovery of refractive index distribution for weakly attenuating objects in a microfocus X-ray system. This is achieved through the development of a discretized operator modeling both the transport of intensity equation and X-ray transform that is suitable for iterative reconstruction techniques. We develop and implement a compressive reconstruction method for tomographic recovery of refractive index distribution for weakly attenuating objects in a microfocus X-ray system. This is achieved through the development of a discretized operator modeling both the transport of intensity equation and X-ray transform that is suitable for iterative reconstruction techniques. △ Less

Submitted 23 June, 2013; v1 submitted 18 April, 2013; originally announced April 2013.

Journal ref: Optics Letters, Vol. 38, Issue 17, pp. 3418-3421 (2013)

Design of thin-film photonic metamaterial Lüneburg lens using analytical approach

Authors: Hanhong Gao, Baile Zhang, Steven G. Johnson, George Barbastathis

Abstract: We design an all-dielectric Lüneburg lens as an adiabatic space-variant lattice explicitly accounting for finite film thickness. We describe an all-analytical approach to compensate for the finite height of subwavelength dielectric structures in the pass-band regime. This method calculates the effective refractive index of the infinite-height lattice from effective medium theory, then embeds a med… ▽ More We design an all-dielectric Lüneburg lens as an adiabatic space-variant lattice explicitly accounting for finite film thickness. We describe an all-analytical approach to compensate for the finite height of subwavelength dielectric structures in the pass-band regime. This method calculates the effective refractive index of the infinite-height lattice from effective medium theory, then embeds a medium of the same effective index into a slab waveguide of finite height and uses the waveguide dispersion diagram to calculate a new effective index. The results are compared with the conventional numerical treatment - a direct band diagram calculation, using a modified three-dimensional lattice with the superstrate and substrate included in the cell geometry. We show that the analytical results are in good agreement with the numerical ones, and the performance of the thin-film Lüneburg lens is quite different than the estimates obtained assuming infinite height. △ Less

Submitted 16 November, 2011; originally announced November 2011.

Comments: 11 pages, 8 figures, uses opex3.sty

Affine nonmagnetic transformation optics and its application to a practical bending adapter design

Authors: Hongyi Xu, Baile Zhang, Tianyuan Yu, George Barbastathis, Handong Sun

Abstract: One of the bottlenecks that limit the transition of transformation-optics devices from concepts to practical use is the non-unit magnetic permeability generally required from a mathematical transformation. Simple renormalization of permeability, as used in many previous designs and experiments, introduces impedance mismatch and thus degrades the functional photonic performance. Here we propose an… ▽ More One of the bottlenecks that limit the transition of transformation-optics devices from concepts to practical use is the non-unit magnetic permeability generally required from a mathematical transformation. Simple renormalization of permeability, as used in many previous designs and experiments, introduces impedance mismatch and thus degrades the functional photonic performance. Here we propose an area-preserving affine coordinate transformation as a general method to solve this problem. Ideal transformation-optics functions can be preserved while nonmagnetism is achieved. As a specific example, we illustrate how to apply this affine method into the design of a two-dimensional electromagnetic beam bending adapter. Concerns related to fabrication, such as anisotropy degree and bending angles, are fully discussed. Our study is a significant step toward practical use of ideal transformation optics devices that can be implemented directly with existing dielectric materials. △ Less

Submitted 8 November, 2011; v1 submitted 30 October, 2011; originally announced October 2011.

Comments: 3 pages, 4 figures

Broadband phase-preserved optical elevator

Authors: Yuan Luo, Tiancheng Han, Baile Zhang, Cheng-Wei Qiu, George Barbastathis

Abstract: Phase-preserved optical elevator is an optical device to lift up an entire plane virtually without distortion in light path or phase. Using transformation optics, we have predicted and observed the realization of such a broadband phase-preserved optical elevator, made of a natural homogeneous birefringent crystal without resorting to absorptive and narrowband metamaterials involving time-consuming… ▽ More Phase-preserved optical elevator is an optical device to lift up an entire plane virtually without distortion in light path or phase. Using transformation optics, we have predicted and observed the realization of such a broadband phase-preserved optical elevator, made of a natural homogeneous birefringent crystal without resorting to absorptive and narrowband metamaterials involving time-consuming nano-fabrication. In our demonstration, the optical elevator is designed to lift a sheet upwards, and the phase is verified to be preserved always. The camouflage capability is also demonstrated in the presence of adjacent objects of the same scale at will. The elevating device functions in different surrounding media over the wavelength range of 400-700 nm. Our work opens up prospects for studies of light trapping, solar energy, illusion optics, communication, and imaging. △ Less

Submitted 30 September, 2011; originally announced September 2011.

Experimental compressive phase space tomography

Authors: Lei Tian, Justin Lee, Se Baek Oh, George Barbastathis

Abstract: Phase space tomography estimates correlation functions entirely from snapshots in the evolution of the wave function along a time or space variable. In contrast, traditional interferometric methods require measurement of multiple two-point correlations. However, as in every tomographic formulation, undersampling poses a severe limitation. Here we present the first, to our knowledge, experimental d… ▽ More Phase space tomography estimates correlation functions entirely from snapshots in the evolution of the wave function along a time or space variable. In contrast, traditional interferometric methods require measurement of multiple two-point correlations. However, as in every tomographic formulation, undersampling poses a severe limitation. Here we present the first, to our knowledge, experimental demonstration of compressive reconstruction of the classical optical correlation function, i.e. the mutual intensity function. Our compressive algorithm makes explicit use of the physically justifiable assumption of a low-entropy source (or state.) Since the source was directly accessible in our classical experiment, we were able to compare the compressive estimate of the mutual intensity to an independent ground-truth estimate from the van Cittert-Zernike theorem and verify substantial quantitative improvements in the reconstruction. △ Less

Submitted 26 March, 2012; v1 submitted 6 September, 2011; originally announced September 2011.

Journal ref: Optics Express Vol. 20, Issue 8, pp. 8296-8308 (2012)

Macroscopic Invisibility Cloak for Visible Light

Authors: Baile Zhang, Yuan Luo, Xiaogang Liu, George Barbastathis

Abstract: Invisibility cloaks, a subject that usually occurs in science fiction and myths, have attracted wide interest recently because of their possible realization. The biggest challenge to true invisibility is known to be the cloaking of a macroscopic object in the broad range of wavelengths visible to the human eye. Here we experimentally solve this problem by incorporating the principle of transformat… ▽ More Invisibility cloaks, a subject that usually occurs in science fiction and myths, have attracted wide interest recently because of their possible realization. The biggest challenge to true invisibility is known to be the cloaking of a macroscopic object in the broad range of wavelengths visible to the human eye. Here we experimentally solve this problem by incorporating the principle of transformation optics into a conventional optical lens fabrication with low-cost materials and simple manufacturing techniques. A transparent cloak made of two pieces of calcite is created. This cloak is able to conceal a macroscopic object with a maximum height of 2 mm, larger than 3500 free-space-wavelength, inside a transparent liquid environment. Its working bandwidth encompassing red, green and blue light is also demonstrated. △ Less

Submitted 23 January, 2011; v1 submitted 10 December, 2010; originally announced December 2010.

Journal ref: Physical Review Letters 106, 033901 (2011)