-
Beyond the blur: using experimentally determined point spread functions to improve scanning Kelvin probe imaging
Authors:
Isaac C. D. Lenton,
Felix Pertl,
Lubuna Shafeek,
Scott R. Waitukaitis
Abstract:
Scanning Kelvin probe microscopy (SKPM) is a powerful technique for investigating the electrostatic properties of material surfaces, enabling the imaging of variations in work function, topology, surface charge density, or combinations thereof. Regardless of the underlying signal source, SKPM results in a voltage image which is spatially distorted due to the finite size of the probe, long-range el…
▽ More
Scanning Kelvin probe microscopy (SKPM) is a powerful technique for investigating the electrostatic properties of material surfaces, enabling the imaging of variations in work function, topology, surface charge density, or combinations thereof. Regardless of the underlying signal source, SKPM results in a voltage image which is spatially distorted due to the finite size of the probe, long-range electrostatic interactions, mechanical and electrical noise, and the finite response time of the electronics. In order to recover the underlying signal, it is necessary to deconvolve the measurement with an appropriate point spread function (PSF) that accounts the aforementioned distortions, but determining this PSF is difficult. Here we describe how such PSFs can be determined experimentally, and show how they can be used to recover the underlying information of interest. We first consider the physical principles that enable SKPM, and discuss how these affect the system PSF. We then show how one can experimentally measure PSFs by looking at well defined features, and that these compare well to simulated PSFs, provided scans are performed extremely slowly and carefully. Next, we work at realistic scan speeds, and show that the idealised PSFs fail to capture temporal distortions in the scan direction. While simulating PSFs for these situations would be quite challenging, we show that measuring PSFs with similar scan conditions works well. Our approach clarifies the basic principles of and inherent challenges to SKPM measurements, and gives practical methods to improve results
△ Less
Submitted 5 July, 2024; v1 submitted 4 April, 2024;
originally announced April 2024.
-
Roadmap on Deep Learning for Microscopy
Authors:
Giovanni Volpe,
Carolina Wählby,
Lei Tian,
Michael Hecht,
Artur Yakimovich,
Kristina Monakhova,
Laura Waller,
Ivo F. Sbalzarini,
Christopher A. Metzler,
Mingyang Xie,
Kevin Zhang,
Isaac C. D. Lenton,
Halina Rubinsztein-Dunlop,
Daniel Brunner,
Bijie Bai,
Aydogan Ozcan,
Daniel Midtvedt,
Hao Wang,
Nataša Sladoje,
Joakim Lindblad,
Jason T. Smith,
Marien Ochoa,
Margarida Barroso,
Xavier Intes,
Tong Qiu
, et al. (50 additional authors not shown)
Abstract:
Through digital imaging, microscopy has evolved from primarily being a means for visual observation of life at the micro- and nano-scale, to a quantitative tool with ever-increasing resolution and throughput. Artificial intelligence, deep neural networks, and machine learning are all niche terms describing computational methods that have gained a pivotal role in microscopy-based research over the…
▽ More
Through digital imaging, microscopy has evolved from primarily being a means for visual observation of life at the micro- and nano-scale, to a quantitative tool with ever-increasing resolution and throughput. Artificial intelligence, deep neural networks, and machine learning are all niche terms describing computational methods that have gained a pivotal role in microscopy-based research over the past decade. This Roadmap is written collectively by prominent researchers and encompasses selected aspects of how machine learning is applied to microscopy image data, with the aim of gaining scientific knowledge by improved image quality, automated detection, segmentation, classification and tracking of objects, and efficient merging of information from multiple imaging modalities. We aim to give the reader an overview of the key developments and an understanding of possibilities and limitations of machine learning for microscopy. It will be of interest to a wide cross-disciplinary audience in the physical sciences and life sciences.
△ Less
Submitted 7 March, 2023;
originally announced March 2023.
-
Machine learning reveals complex behaviours in optically trapped particles
Authors:
Isaac C. D. Lenton,
Giovanni Volpe,
Alexander B. Stilgoe,
Timo A. Nieminen,
Halina Rubinsztein-Dunlop
Abstract:
Since their invention in the 1980s [1], optical tweezers have found a wide range of applications, from biophotonics and mechanobiology to microscopy and optomechanics [2, 3, 4, 5]. Simulations of the motion of microscopic particles held by optical tweezers are often required to explore complex phenomena and to interpret experimental data [6, 7, 8, 9]. For the sake of computational efficiency, thes…
▽ More
Since their invention in the 1980s [1], optical tweezers have found a wide range of applications, from biophotonics and mechanobiology to microscopy and optomechanics [2, 3, 4, 5]. Simulations of the motion of microscopic particles held by optical tweezers are often required to explore complex phenomena and to interpret experimental data [6, 7, 8, 9]. For the sake of computational efficiency, these simulations usually model the optical tweezers as an harmonic potential [10, 11]. However, more physically-accurate optical-scattering models [12, 13, 14, 15] are required to accurately model more onerous systems; this is especially true for optical traps generated with complex fields [16, 17, 18, 19]. Although accurate, these models tend to be prohibitively slow for problems with more than one or two degrees of freedom (DoF) [20], which has limited their broad adoption. Here, we demonstrate that machine learning permits one to combine the speed of the harmonic model with the accuracy of optical-scattering models. Specifically, we show that a neural network can be trained to rapidly and accurately predict the optical forces acting on a microscopic particle. We demonstrate the utility of this approach on two phenomena that are prohibitively slow to accurately simulate otherwise: the escape dynamics of swelling microparticles in an optical trap, and the rotation rates of particles in a superposition of beams with opposite orbital angular momenta. Thanks to its high speed and accuracy, this method can greatly enhance the range of phenomena that can be efficiently simulated and studied.
△ Less
Submitted 17 April, 2020;
originally announced April 2020.
-
OTSLM Toolbox for Structured Light Methods
Authors:
Isaac C D Lenton,
Alexander B Stilgoe,
Timo A Nieminen,
Halina Rubinsztein-Dunlop
Abstract:
We present a new Matlab toolbox for generating phase and amplitude patterns for digital micro-mirror device (DMD) and liquid crystal (LC) based spatial light modulators (SLMs). This toolbox consists of a collection of algorithms commonly used for generating patterns for these devices with a focus on optical tweezers beam shaping applications. In addition to the algorithms provided, we have put tog…
▽ More
We present a new Matlab toolbox for generating phase and amplitude patterns for digital micro-mirror device (DMD) and liquid crystal (LC) based spatial light modulators (SLMs). This toolbox consists of a collection of algorithms commonly used for generating patterns for these devices with a focus on optical tweezers beam shaping applications. In addition to the algorithms provided, we have put together a range of user interfaces for simplifying the use of these patterns. The toolbox currently has functionality to generate patterns which can be saved as a image or displayed on a device/screen using the supplied interface. We have only implemented interfaces for the devices our group currently uses but we believe that extending the code we provide to other devices should be fairly straightforward. The range of algorithms included in the toolbox is not exhaustive. However, by making the toolbox open sources and available on GitHub we hope that other researchers working with these devices will contribute their patterns/algorithms to the toolbox.
△ Less
Submitted 17 February, 2020;
originally announced February 2020.
-
Orientation of Swimming Cells with Annular Beam Optical Tweezers
Authors:
Isaac C. D. Lenton,
Declan J. Armstrong,
Alexander B. Stilgoe,
Timo A. Nieminen,
Halina Rubinsztein-Dunlop
Abstract:
Optical tweezers are a versatile tool that can be used to manipulate small particles including both motile and non-motile bacteria and cells. The orientation of a non-spherical particle within a beam depends on the shape of the particle and the shape of the light field. By using multiple beams, sculpted light fields or dynamically changing beams, it is possible to control the orientation of certai…
▽ More
Optical tweezers are a versatile tool that can be used to manipulate small particles including both motile and non-motile bacteria and cells. The orientation of a non-spherical particle within a beam depends on the shape of the particle and the shape of the light field. By using multiple beams, sculpted light fields or dynamically changing beams, it is possible to control the orientation of certain particles. In this paper we discuss the orientation of the rod-shaped bacteria Escherichia coli (E. coli) using dynamically shifting annular beam optical tweezers. We begin with examples of different beams used for the orientation of rod-shaped particles. We discuss the differences between orientation of motile and non-motile particles, and explore annular beams and the circumstances when they may be beneficial for manipulation of non-spherical particles or cells. Using simulations we map out the trajectory the E. coli takes. Estimating the trap stiffness along the trajectory gives us an insight into how stable an intermediate rotation is with respect to the desired orientation. Using this method, we predict and experimentally verify the change in the orientation of motile E. coli from vertical to near-horizontal with only one intermediate step. The method is not specific to exploring the orientation of particles and could be easily extended to quantify the stability of an arbitrary particle trajectory.
△ Less
Submitted 13 November, 2019;
originally announced November 2019.
-
Theory and practice of simulation of optical tweezers
Authors:
Ann A. M. Bui,
Alexander B. Stilgoe,
Isaac C. D. Lenton,
Lachlan J. Gibson,
Anatolii V. Kashchuk,
Shu Zhang,
Halina Rubinsztein-Dunlop,
Timo A. Nieminen
Abstract:
Computational modelling has made many useful contributions to the field of optical tweezers. One aspect in which it can be applied is the simulation of the dynamics of particles in optical tweezers. This can be useful for systems with many degrees of freedom, and for the simulation of experiments. While modelling of the optical force is a prerequisite for simulation of the motion of particles in o…
▽ More
Computational modelling has made many useful contributions to the field of optical tweezers. One aspect in which it can be applied is the simulation of the dynamics of particles in optical tweezers. This can be useful for systems with many degrees of freedom, and for the simulation of experiments. While modelling of the optical force is a prerequisite for simulation of the motion of particles in optical traps, non-optical forces must also be included; the most important are usually Brownian motion and viscous drag. We discuss some applications and examples of such simulations. We review the theory and practical principles of simulation of optical tweezers, including the choice of method of calculation of optical force, numerical solution of the equations of motion of the particle, and finish with a discussion of a range of open problems.
△ Less
Submitted 20 August, 2017;
originally announced August 2017.
-
Visual guide to optical tweezers
Authors:
Isaac C. D. Lenton,
Alexander B. Stilgoe,
Halina Rubinsztein-Dunlop,
Timo A. Nieminen
Abstract:
It is common to introduce optical tweezers using either geometric optics for large particles or the Rayleigh approximation for very small particles. These approaches are successful at conveying the key ideas behind optical tweezers in their respective regimes. However, they are insufficient for modelling particles of intermediate size and large particles with small features. For this, a full field…
▽ More
It is common to introduce optical tweezers using either geometric optics for large particles or the Rayleigh approximation for very small particles. These approaches are successful at conveying the key ideas behind optical tweezers in their respective regimes. However, they are insufficient for modelling particles of intermediate size and large particles with small features. For this, a full field approach provides greater insight into the mechanisms involved in trapping. The advances in computational capability over the last decade has led to better modelling and understanding of optical tweezers. Problems that were previously difficult to model computationally can now be solved using a variety of methods on modern systems. These advances in computational power allow for full field solutions to be visualised, leading to increased understanding of the fields and behaviour in various scenarios. In this paper we describe the operation of optical tweezers using full field simulations calculated using the finite difference time domain method. We use these simulations to visually illustrate various situations relevant to optical tweezers, from the basic operation of optical tweezers, to engineered particles and evanescent fields.
△ Less
Submitted 15 August, 2017;
originally announced August 2017.
