-
A Physics-Informed Machine Learning Approach utilizing Multiband Satellite Data for Solar Irradiance Estimation
Authors:
Jun Sasaki,
Maki Okada,
Kenji Utsunomiya,
Koji Yamaguchi
Abstract:
Solar irradiance is fundamental data crucial for analyses related to weather and climate. High-precision estimation models are necessary to create areal data for solar irradiance. In this study, we developed a novel estimation model by utilizing machine learning and multiband data from meteorological satellite observations. Particularly under clear-sky and thin clouds, satellite observations can b…
▽ More
Solar irradiance is fundamental data crucial for analyses related to weather and climate. High-precision estimation models are necessary to create areal data for solar irradiance. In this study, we developed a novel estimation model by utilizing machine learning and multiband data from meteorological satellite observations. Particularly under clear-sky and thin clouds, satellite observations can be influenced by surface reflections, which may lead to overfitting to ground observations. To make the model applicable at any location, we constructed the model incorporating prior information such as radiative transfer models and clear-sky probability, based on physical and meteorological knowledge. As a result, the estimation accuracy significantly improved at validation sites.
△ Less
Submitted 5 July, 2024;
originally announced July 2024.
-
Mesoscopic Bayesian Inference by Solvable Models
Authors:
Shun Katakami,
Shuhei Kashiwamura,
Kenji Nagata,
Masaichiro Mizumaki,
Masato Okada
Abstract:
The rapid advancement of data science and artificial intelligence has influenced physics in numerous ways, including the application of Bayesian inference. Our group has proposed Bayesian measurement, a framework that applies Bayesian inference to measurement science and is applicable across various natural sciences. This framework enables the determination of posterior probability distributions f…
▽ More
The rapid advancement of data science and artificial intelligence has influenced physics in numerous ways, including the application of Bayesian inference. Our group has proposed Bayesian measurement, a framework that applies Bayesian inference to measurement science and is applicable across various natural sciences. This framework enables the determination of posterior probability distributions for system parameters, model selection, and the integration of multiple measurement datasets. However, a theoretical framework to address fluctuations in these results due to finite measurement data (N) is still needed. In this paper, we suggest a mesoscopic theoretical framework for the components of Bayesian measurement-parameter estimation, model selection, and Bayesian integration-within the mesoscopic region where (N) is finite. We develop a solvable theory for linear regression with Gaussian noise, which is practical for real-world measurements and as an approximation for nonlinear models with large (N). By utilizing mesoscopic Gaussian and chi-squared distributions, we aim to analytically evaluate the three components of Bayesian measurement. Our results offer a novel approach to understanding fluctuations in Bayesian measurement outcomes.
△ Less
Submitted 4 June, 2024;
originally announced June 2024.
-
Bayesian Inference for Small-Angle Scattering Data in Core-Shell Samples
Authors:
Keigo Oyama,
Yui Hayashi,
Shigeo Kuwamoto,
Shun Katakami,
Kenji Nagata,
Masaichiro Mizumaki,
Masato Okada
Abstract:
Small-angle scattering (SAS) techniques, which utilize neutrons and X-rays, are employed in various scientific fields, including materials science, biochemistry, and polymer physics. During the analysis of SAS data, model parameters that contain information about the sample are estimated by fitting the observational data to a model of sample. Previous research has demonstrated the effectiveness of…
▽ More
Small-angle scattering (SAS) techniques, which utilize neutrons and X-rays, are employed in various scientific fields, including materials science, biochemistry, and polymer physics. During the analysis of SAS data, model parameters that contain information about the sample are estimated by fitting the observational data to a model of sample. Previous research has demonstrated the effectiveness of Bayesian inference in analyzing SAS data using a sphere model. However, compared with the sphere model, the core-shell model, which represents functional nanoparticles, offers higher application potential and greater analytical value. Therefore, in this study, we propose an analytical method for the more complex and practical core-shell model based on Bayesian inference. Through numerical experiments, we evaluated the performance of this method under different conditions, including measurement times, number of data points, and differences in scattering length density. As a result, we clarify the conditions under which accurate estimations are possible.
△ Less
Submitted 12 May, 2024;
originally announced May 2024.
-
Basis Function Dependence of Estimation Precision for Synchrotron-Radiation-Based Mössbauer Spectroscopy
Authors:
Binsheu Shieh,
Ryo Masuda,
Satoshi Tsutsui,
Shun Katakami,
Kenji Nagata,
Masaichiro Mizumaki,
Masato Okada
Abstract:
Mössbauer spectroscopy is a technique employed to investigate the microscopic properties of materials using transitions between energy levels in the nuclei. Conventionally, in synchrotron-radiation-based Mössbauer spectroscopy, the measurement window is decided by the researcher heuristically, although this decision has a significant impact on the shape of the measurement spectra. In this paper, w…
▽ More
Mössbauer spectroscopy is a technique employed to investigate the microscopic properties of materials using transitions between energy levels in the nuclei. Conventionally, in synchrotron-radiation-based Mössbauer spectroscopy, the measurement window is decided by the researcher heuristically, although this decision has a significant impact on the shape of the measurement spectra. In this paper, we propose a method for evaluating the precision of the spectral position by introducing Bayesian estimation. The proposed method makes it possible to select the best measurement window by calculating the precision of Mössbauer spectroscopy from the data. Based on the results, the precision of the Mössbauer center shifts improved by more than three times compared with the results achieved with the conventional simple fitting method using the Lorentzian function.
△ Less
Submitted 22 April, 2024;
originally announced April 2024.
-
Quantitative Selection of Sample Structures in Small-Angle Scattering Using Bayesian Methods
Authors:
Yui Hayashi,
Shun Katakami,
Shigeo Kuwamoto,
Kenji Nagata,
Masaichiro Mizumaki,
Masato Okada
Abstract:
Small-angle scattering (SAS) is a key experimental technique for analyzing nano-scale structures in various materials.In SAS data analysis, selecting an appropriate mathematical model for the scattering intensity is critical, as it generates a hypothesis of the structure of the experimental sample. Traditional model selection methods either rely on qualitative approaches or are prone to overfittin…
▽ More
Small-angle scattering (SAS) is a key experimental technique for analyzing nano-scale structures in various materials.In SAS data analysis, selecting an appropriate mathematical model for the scattering intensity is critical, as it generates a hypothesis of the structure of the experimental sample. Traditional model selection methods either rely on qualitative approaches or are prone to overfitting.This paper introduces an analytical method that applies Bayesian model selection to SAS measurement data, enabling a quantitative evaluation of the validity of mathematical models.We assess the performance of our method through numerical experiments using artificial data for multicomponent spherical materials, demonstrating that our proposed method analysis approach yields highly accurate and interpretable results.We also discuss the ability of our method to analyze a range of mixing ratios and particle size ratios for mixed components, along with its precision in model evaluation by the degree of fitting.Our proposed method effectively facilitates quantitative analysis of nano-scale sample structures in SAS, which has traditionally been challenging, and is expected to significantly contribute to advancements in a wide range of fields.
△ Less
Submitted 18 January, 2024;
originally announced January 2024.
-
Sequential Experimental Design for Spectral Measurement: Active Learning Using a Parametric Model
Authors:
Tomohiro Nabika,
Kenji Nagata,
Shun Katakami,
Masaichiro Mizumaki,
Masato Okada
Abstract:
In this study, we demonstrate a sequential experimental design for spectral measurements by active learning using parametric models as predictors. In spectral measurements, it is necessary to reduce the measurement time because of sample fragility and high energy costs. To improve the efficiency of experiments, sequential experimental designs are proposed, in which the subsequent measurement is de…
▽ More
In this study, we demonstrate a sequential experimental design for spectral measurements by active learning using parametric models as predictors. In spectral measurements, it is necessary to reduce the measurement time because of sample fragility and high energy costs. To improve the efficiency of experiments, sequential experimental designs are proposed, in which the subsequent measurement is designed by active learning using the data obtained before the measurement. Conventionally, parametric models are employed in data analysis; when employed for active learning, they are expected to afford a sequential experimental design that improves the accuracy of data analysis. However, due to the complexity of the formulas, a sequential experimental design using general parametric models has not been realized. Therefore, we applied Bayesian inference-based data analysis using the exchange Monte Carlo method to realize a sequential experimental design with general parametric models. In this study, we evaluated the effectiveness of the proposed method by applying it to Bayesian spectral deconvolution and Bayesian Hamiltonian selection in X-ray photoelectron spectroscopy. Using numerical experiments with artificial data, we demonstrated that the proposed method improves the accuracy of model selection and parameter estimation while reducing the measurement time compared with the results achieved without active learning or with active learning using the Gaussian process regression.
△ Less
Submitted 11 May, 2023;
originally announced May 2023.
-
Bayesian Inference for Small-Angle Scattering Data
Authors:
Yui Hayashi,
Shun Katakami,
Shigeo Kuwamoto,
Kenji Nagata,
Masaichiro Mizumaki,
Masato Okada
Abstract:
In this paper, we propose a method for estimating model parameters using Small-Angle Scattering (SAS) data based on the Bayesian inference. Conventional SAS data analyses involve processes of manual parameter adjustment by analysts or optimization using gradient methods. These analysis processes tend to involve heuristic approaches and may lead to local solutions.Furthermore, it is difficult to ev…
▽ More
In this paper, we propose a method for estimating model parameters using Small-Angle Scattering (SAS) data based on the Bayesian inference. Conventional SAS data analyses involve processes of manual parameter adjustment by analysts or optimization using gradient methods. These analysis processes tend to involve heuristic approaches and may lead to local solutions.Furthermore, it is difficult to evaluate the reliability of the results obtained by conventional analysis methods. Our method solves these problems by estimating model parameters as probability distributions from SAS data using the framework of the Bayesian inference. We evaluate the performance of our method through numerical experiments using artificial data of representative measurement target models.From the results of the numerical experiments, we show that our method provides not only high accuracy and reliability of estimation, but also perspectives on the transition point of estimability with respect to the measurement time and the lower bound of the angular domain of the measured data.
△ Less
Submitted 28 July, 2023; v1 submitted 8 March, 2023;
originally announced March 2023.
-
Effective implementation of $l_0$-Regularised Compressed Sensing with Chaotic-Amplitude-Controlled Coherent Ising Machines
Authors:
Mastiyage Don Sudeera Hasaranga Gunathilaka,
Satoshi Kako,
Yoshitaka Inui,
Kazushi Mimura,
Masato Okada,
Yoshihisa Yamamoto,
Toru Aonishi
Abstract:
Coherent Ising Machine (CIM) is a network of optical parametric oscillators that can solve large-scale combinatorial optimisation problems by finding the ground state of an Ising Hamiltonian. As a practical application of CIM, Aonishi et al., proposed a quantum-classical hybrid system to solve optimisation problems of $l_0$-regularisation-based compressed sensing. In the hybrid system, the CIM was…
▽ More
Coherent Ising Machine (CIM) is a network of optical parametric oscillators that can solve large-scale combinatorial optimisation problems by finding the ground state of an Ising Hamiltonian. As a practical application of CIM, Aonishi et al., proposed a quantum-classical hybrid system to solve optimisation problems of $l_0$-regularisation-based compressed sensing. In the hybrid system, the CIM was an open-loop system without an amplitude control feedback loop. In this case, the hybrid system is enhanced by using a closed-loop CIM to achieve chaotic behaviour around the target amplitude, which would enable escaping from local minima in the energy landscape. Both artificial and magnetic resonance image data were used for the testing of our proposed closed-loop system. Compared with the open-loop system, the results of this study demonstrate an improved degree of accuracy and a wider range of effectiveness.
△ Less
Submitted 24 February, 2023;
originally announced February 2023.
-
Bayesian Inference of Absorption Spectra Based on Binomial Distribution
Authors:
Tomohiro Nabika,
Kenji Nagata,
Shun Katakami,
Masaichiro Mizumaki,
Masato Okada
Abstract:
In this paper, we propose a Bayesian spectral deconvolution method for absorption spectra. In conventional analysis, the noise mechanism of absorption spectral data is never considered appropriately. In that analysis, the least-squares method, which assumes Gaussian noise from the perspective of Bayesian statistics, is frequently used. Since Bayesian inference is possible by introducing an appropr…
▽ More
In this paper, we propose a Bayesian spectral deconvolution method for absorption spectra. In conventional analysis, the noise mechanism of absorption spectral data is never considered appropriately. In that analysis, the least-squares method, which assumes Gaussian noise from the perspective of Bayesian statistics, is frequently used. Since Bayesian inference is possible by introducing an appropriate noise model for the data, we consider the absorption process of a single photon to be a Bernoulli trial and develop a Bayesian spectral deconvolution method based on binomial distribution. We have evaluated our method on artificial data under several conditions by numerical experiments. The results show that our method not only allows us to estimate parameters with high accuracy from absorption spectral data, but also to infer them even from absorption spectral data with large absorption rates where the spectral structure is flattened, which was previously impossible to analyze.
△ Less
Submitted 20 April, 2023; v1 submitted 14 December, 2022;
originally announced December 2022.
-
Bayesian Inference on Hamiltonian Selections for Mössbauer Spectroscopy
Authors:
Ryota Moriguchi,
Satoshi Tsutsui,
Shun Katakami,
Kenji Nagata,
Masaichiro Mizumaki,
Masato Okada
Abstract:
Mössbauer spectroscopy, which provides knowledge related to electronic states in materials, has been applied to various fields such as condensed matter physics and material sciences. In conventional spectral analyses based on least-square fitting, hyperfine interactions in materials have been determined from the shape of observed spectra. In conventional spectral analyses, it is difficult to discu…
▽ More
Mössbauer spectroscopy, which provides knowledge related to electronic states in materials, has been applied to various fields such as condensed matter physics and material sciences. In conventional spectral analyses based on least-square fitting, hyperfine interactions in materials have been determined from the shape of observed spectra. In conventional spectral analyses, it is difficult to discuss the validity of the hyperfine interactions and the estimated values. We propose a spectral analysis method based on Bayesian inference for the selection of hyperfine interactions and the estimation of Mössbauer parameters. An appropriate Hamiltonian has been selected by comparing Bayesian free energy among possible Hamiltonians. We have estimated the Mössbauer parameters and evaluated their estimated values by calculating the posterior distribution of each Mössbauer parameter with confidence intervals. We have also discussed the accuracy of the spectral analyses to elucidate the noise intensity dependence of numerical experiments.
△ Less
Submitted 2 May, 2022;
originally announced May 2022.
-
Appropriate basis selection based on Bayesian inference for analyzing measured data reflecting photoelectron wave interference
Authors:
Yasuhiko Igarashi,
Fabio Iesari,
Hiroyuki Setoyama,
Toshihiro Okajima,
Hiroyuki Kumazoe,
Ichiro Akai,
Masato Okada
Abstract:
In this study, we applied Bayesian inference for extended X-ray absorption fine structure (EXAFS) to select an appropriate basis from among Fourier, wavelet and advanced Fourier bases, and we extracted a radial distribution function (RDF) and physical parameters from only EXAFS signals using physical prior knowledge, which is to be realized in general in condensed systems. To evaluate our method,…
▽ More
In this study, we applied Bayesian inference for extended X-ray absorption fine structure (EXAFS) to select an appropriate basis from among Fourier, wavelet and advanced Fourier bases, and we extracted a radial distribution function (RDF) and physical parameters from only EXAFS signals using physical prior knowledge, which is to be realized in general in condensed systems. To evaluate our method, the well-known EXAFS spectrum of copper was used for the EXAFS data analysis. We found that the advanced Fourier basis is selected as an appropriate basis for the regression of the EXAFS signal in a quantitative way and that the estimation of the Debye-Waller factor can be robustly realized only by using the advanced Fourier basis. Bayesian inference based on minimal restrictions allows us to not only eliminate some unphysical results but also select an appropriate basis. Generally, FEFF analysis is used for estimating physical parameters such as Deby-Waller and extracting RDF. Bayesian inference enables us to simultaneously select an appropriate basis and optimized physical parameters without FEFF analysis, which results in extracting RDF from only EXAFS signals. These advantages lead to the general usage of Bayesian inference for EXAFS data analysis.
△ Less
Submitted 5 May, 2021;
originally announced May 2021.
-
Sparse Modeling analysis of Extended X-ray Absorption Fine Structure data using two-body expansion
Authors:
Fabio Iesari,
Hiroyuki Setoyama,
Yasuhiko Igarashi,
Masato Okada,
Hiroyuki Kumazoe,
Kazunori Iwamitsu,
Ichiro Akai,
Yoshiki Seno,
Toshihiro Okajima
Abstract:
Analysis of extended X-ray absorption fine structure (EXAFS) data by the use of sparse modeling is presented. We consider the two-body term in the n-body expansion of the EXAFS signal to implement the method, together with calculations of amplitudes and phase shifts to distinguish between different back-scattering elements. Within this approach no a priori assumption about the structure is used, o…
▽ More
Analysis of extended X-ray absorption fine structure (EXAFS) data by the use of sparse modeling is presented. We consider the two-body term in the n-body expansion of the EXAFS signal to implement the method, together with calculations of amplitudes and phase shifts to distinguish between different back-scattering elements. Within this approach no a priori assumption about the structure is used, other than the elements present inside the material. We apply the method to the experimental EXAFS signal of metals and oxides, for which we were able to extract the radial distribution function peak positions, and the Debye-Waller factor for first neighbors.
△ Less
Submitted 5 April, 2021;
originally announced April 2021.
-
L0 regularization-based compressed sensing with quantum-classical hybrid approach
Authors:
Toru Aonishi,
Kazushi Mimura,
Masato Okada,
Yoshihisa Yamamoto
Abstract:
L0-regularization-based compressed sensing (L0-RBCS) has the potential to outperform L1-regularization-based compressed sensing (L1-RBCS), but the optimization in L0-RBCS is difficult because it is a combinatorial optimization problem. To perform optimization in L0-RBCS, we propose a quantum-classical hybrid system consisting of a quantum machine and a classical digital processor. The coherent Isi…
▽ More
L0-regularization-based compressed sensing (L0-RBCS) has the potential to outperform L1-regularization-based compressed sensing (L1-RBCS), but the optimization in L0-RBCS is difficult because it is a combinatorial optimization problem. To perform optimization in L0-RBCS, we propose a quantum-classical hybrid system consisting of a quantum machine and a classical digital processor. The coherent Ising machine (CIM) is a suitable quantum machine for this system because this optimization problem can only be solved with a densely connected network. To evaluate the performance of the CIM-classical hybrid system theoretically, a truncated Wigner stochastic differential equation (W-SDE) is introduced as a model for the network of degenerate optical parametric oscillators, and macroscopic equations are derived by applying statistical mechanics to the W-SDE. We show that the system performance in principle approaches the theoretical limit of compressed sensing and this hybrid system may exceed the estimation accuracy of L1-RBCS in actual situations, such as in magnetic resonance imaging data analysis.
△ Less
Submitted 6 May, 2022; v1 submitted 22 February, 2021;
originally announced February 2021.
-
Fast Bayesian Deconvolution using Simple Reversible Jump Moves
Authors:
Koki Okajima,
Kenji Nagata,
Masato Okada
Abstract:
We propose a Markov chain Monte Carlo-based deconvolution method designed to estimate the number of peaks in spectral data, along with the optimal parameters of each radial basis function. Assuming cases where the number of peaks is unknown, and a sweep simulation on all candidate models is computationally unrealistic, the proposed method efficiently searches over the probable candidates via trans…
▽ More
We propose a Markov chain Monte Carlo-based deconvolution method designed to estimate the number of peaks in spectral data, along with the optimal parameters of each radial basis function. Assuming cases where the number of peaks is unknown, and a sweep simulation on all candidate models is computationally unrealistic, the proposed method efficiently searches over the probable candidates via trans-dimensional moves assisted by annealing effects from replica exchange Monte Carlo moves. Through simulation using synthetic data, the proposed method demonstrates its advantages over conventional sweep simulations, particularly in model selection problems. Application to a set of olivine reflectance spectral data with varying forsterite and fayalite mixture ratios reproduced results obtained from previous mineralogical research, indicating that our method is applicable to deconvolution on real data sets.
△ Less
Submitted 26 November, 2020;
originally announced November 2020.
-
Silicon emissivity as a function of temperature
Authors:
Marcio Constancio Jr,
Rana X. Adhikari,
Odylio D. Aguiar,
Koji Arai,
Aaron Markowitz,
Marcos A. Okada,
Chris C. Wipf
Abstract:
In this paper we present the temperature-dependent emissivity of a silicon sample, estimated from its cool-down curve in a constant low temperature environment ($\approx$ 82K). The emissivity value follow a linear dependency in the 120-260 K temperature range. This result is of great interest to the LIGO Voyager gravitational wave interferometer project since it would mean that no extra high therm…
▽ More
In this paper we present the temperature-dependent emissivity of a silicon sample, estimated from its cool-down curve in a constant low temperature environment ($\approx$ 82K). The emissivity value follow a linear dependency in the 120-260 K temperature range. This result is of great interest to the LIGO Voyager gravitational wave interferometer project since it would mean that no extra high thermal emissivity coating on the test masses would be required in order to cool them down to 123 K. The results presented here indicate that bulk silicon itself can have sufficient thermal emissivity in order to cool the 200 kg LIGO Voyager test masses only by radiation in a reasonable short amount of time (less than a week). However, it is still not clear if the natural emissivity of silicon will be sufficient to maintain the LIGO Voyager test masses at the desired temperature (123 K) while removing power absorbed by the test masses. With the present results, a black coating on the barrel surface of the test masses would be necessary if power in excess of 6 W is delivered. However, the agreement we found between the hemispherical emissivity obtained by a theory of semi-transparent Silicon and the obtained experimental results makes us believe that the LIGO Voyager test masses, because of their dimensions, will have effective emissivities around 0.7, which would be enough to remove about 8.6 W (7.5 W) for a shield at 60 K (80K). This hypothesis may be confirmed in the near future with new measurements.
△ Less
Submitted 24 April, 2020; v1 submitted 13 April, 2020;
originally announced April 2020.
-
A Cryogenic Silicon Interferometer for Gravitational-wave Detection
Authors:
Rana X Adhikari,
Odylio Aguiar,
Koji Arai,
Bryan Barr,
Riccardo Bassiri,
Garilynn Billingsley,
Ross Birney,
David Blair,
Joseph Briggs,
Aidan F Brooks,
Daniel D Brown,
Huy-Tuong Cao,
Marcio Constancio,
Sam Cooper,
Thomas Corbitt,
Dennis Coyne,
Edward Daw,
Johannes Eichholz,
Martin Fejer,
Andreas Freise,
Valery Frolov,
Slawomir Gras,
Anna Green,
Hartmut Grote,
Eric K Gustafson
, et al. (86 additional authors not shown)
Abstract:
The detection of gravitational waves from compact binary mergers by LIGO has opened the era of gravitational wave astronomy, revealing a previously hidden side of the cosmos. To maximize the reach of the existing LIGO observatory facilities, we have designed a new instrument that will have 5 times the range of Advanced LIGO, or greater than 100 times the event rate. Observations with this new inst…
▽ More
The detection of gravitational waves from compact binary mergers by LIGO has opened the era of gravitational wave astronomy, revealing a previously hidden side of the cosmos. To maximize the reach of the existing LIGO observatory facilities, we have designed a new instrument that will have 5 times the range of Advanced LIGO, or greater than 100 times the event rate. Observations with this new instrument will make possible dramatic steps toward understanding the physics of the nearby universe, as well as observing the universe out to cosmological distances by the detection of binary black hole coalescences. This article presents the instrument design and a quantitative analysis of the anticipated noise floor.
△ Less
Submitted 9 June, 2020; v1 submitted 29 January, 2020;
originally announced January 2020.
-
Intrinsic regularization effect in Bayesian nonlinear regression scaled by observed data
Authors:
Satoru Tokuda,
Kenji Nagata,
Masato Okada
Abstract:
Occam's razor is a guiding principle that models should be simple enough to describe observed data. While Bayesian model selection (BMS) embodies it by the intrinsic regularization effect (IRE), how observed data scale the IRE has not been fully understood. In the nonlinear regression with conditionally independent observations, we show that the IRE is scaled by observations' fineness, defined by…
▽ More
Occam's razor is a guiding principle that models should be simple enough to describe observed data. While Bayesian model selection (BMS) embodies it by the intrinsic regularization effect (IRE), how observed data scale the IRE has not been fully understood. In the nonlinear regression with conditionally independent observations, we show that the IRE is scaled by observations' fineness, defined by the amount and quality of observed data. We introduce an observable that quantifies the IRE, referred to as the Bayes specific heat, inspired by the correspondence between statistical inference and statistical physics. We derive its scaling relation to observations' fineness. We demonstrate that the optimal model chosen by the BMS changes at critical values of observations' fineness, accompanying the IRE's variation. The changes are from choosing a coarse-grained model to a fine-grained one as observations' fineness increases. Our findings expand an understanding of BMS's typicality when observed data are insufficient.
△ Less
Submitted 6 December, 2022; v1 submitted 5 January, 2020;
originally announced January 2020.
-
Extending the PZT bandwidth of an optical interferometer by suppressing resonance using a high dimensional IIR filter implemented on an FPGA
Authors:
Masanori Okada,
Takahiro Serikawa,
James Dannatt,
Masaya Kobayashi,
Atsushi Sakaguchi,
Ian Petersen,
Akira Furusawa
Abstract:
This paper considers the application of FPGA-based IIR filtering to increase the usable bandwidth of a piezoelectric transducer used in optical phase locking. We experimentally perform system identification of the interferometer system with the cross-correlation method integrated on the controller hardware. Our model is then used to implement an inverse filter designed to suppress the low frequenc…
▽ More
This paper considers the application of FPGA-based IIR filtering to increase the usable bandwidth of a piezoelectric transducer used in optical phase locking. We experimentally perform system identification of the interferometer system with the cross-correlation method integrated on the controller hardware. Our model is then used to implement an inverse filter designed to suppress the low frequency resonant modes of the piezo-electric transducer. This filter is realized as an 24th-order IIR filter on the FPGA, while the total input-output delay is kept at 350ns. The combination of the inverse filter and the piezo-electric transducer works as a nearly-flat response position actuator, allowing us to use PI control in order to achieve stability of the closed-loop system with significant improvements over non filtered PI control. Finally, because this controller is completely digital, it is straight forward to reproduce. Our control scheme is suitable for many experiments which require highly accurate control of flexible structures.
△ Less
Submitted 23 December, 2019;
originally announced December 2019.
-
Long-tailed distributions of inter-event times as mixtures of exponential distributions
Authors:
Makoto Okada,
Kenji Yamanishi,
Naoki Masuda
Abstract:
Inter-event times of various human behavior are apparently non-Poissonian and obey long-tailed distributions as opposed to exponential distributions, which correspond to Poisson processes. It has been suggested that human individuals may switch between different states in each of which they are regarded to generate events obeying a Poisson process. If this is the case, inter-event times should app…
▽ More
Inter-event times of various human behavior are apparently non-Poissonian and obey long-tailed distributions as opposed to exponential distributions, which correspond to Poisson processes. It has been suggested that human individuals may switch between different states in each of which they are regarded to generate events obeying a Poisson process. If this is the case, inter-event times should approximately obey a mixture of exponential distributions with different parameter values. In the present study, we introduce the minimum description length principle to compare mixtures of exponential distributions with different numbers of components (i.e., constituent exponential distributions). Because these distributions violate the identifiability property, one is mathematically not allowed to apply the Akaike or Bayes information criteria to their maximum likelihood estimator to carry out model selection. We overcome this theoretical barrier by applying a minimum description principle to joint likelihoods of the data and latent variables. We show that mixtures of exponential distributions with a few components are selected as opposed to more complex mixtures in various data sets and that the fitting accuracy is comparable to that of state-of-the-art algorithms to fit power-law distributions to data. Our results lend support to Poissonian explanations of apparently non-Poissonian human behavior.
△ Less
Submitted 26 February, 2020; v1 submitted 30 April, 2019;
originally announced May 2019.
-
Bayesian Spectral Deconvolution Based on Poisson Distribution: Bayesian Measurement and Virtual Measurement Analytics (VMA)
Authors:
Kenji Nagata,
Yoh-ichi Mototake,
Rei Muraoka,
Takehiko Sasaki,
Masato Okada
Abstract:
In this paper, we propose a new method of Bayesian measurement for spectral deconvolution, which regresses spectral data into the sum of unimodal basis function such as Gaussian or Lorentzian functions. Bayesian measurement is a framework for considering not only the target physical model but also the measurement model as a probabilistic model, and enables us to estimate the parameter of a physica…
▽ More
In this paper, we propose a new method of Bayesian measurement for spectral deconvolution, which regresses spectral data into the sum of unimodal basis function such as Gaussian or Lorentzian functions. Bayesian measurement is a framework for considering not only the target physical model but also the measurement model as a probabilistic model, and enables us to estimate the parameter of a physical model with its confidence interval through a Bayesian posterior distribution given a measurement data set. The measurement with Poisson noise is one of the most effective system to apply our proposed method. Since the measurement time is strongly related to the signal-to-noise ratio for the Poisson noise model, Bayesian measurement with Poisson noise model enables us to clarify the relationship between the measurement time and the limit of estimation. In this study, we establish the probabilistic model with Poisson noise for spectral deconvolution. Bayesian measurement enables us to perform virtual and computer simulation for a certain measurement through the established probabilistic model. This property is called "Virtual Measurement Analytics(VMA)" in this paper. We also show that the relationship between the measurement time and the limit of estimation can be extracted by using the proposed method in a simulation of synthetic data and real data for XPS measurement of MoS$_2$.
△ Less
Submitted 11 December, 2018;
originally announced December 2018.
-
Simultaneous Estimation of Noise Variance and Number of Peaks in Bayesian Spectral Deconvolution
Authors:
Satoru Tokuda,
Kenji Nagata,
Masato Okada
Abstract:
The heuristic identification of peaks from noisy complex spectra often leads to misunderstanding of the physical and chemical properties of matter. In this paper, we propose a framework based on Bayesian inference, which enables us to separate multipeak spectra into single peaks statistically and consists of two steps. The first step is estimating both the noise variance and the number of peaks as…
▽ More
The heuristic identification of peaks from noisy complex spectra often leads to misunderstanding of the physical and chemical properties of matter. In this paper, we propose a framework based on Bayesian inference, which enables us to separate multipeak spectra into single peaks statistically and consists of two steps. The first step is estimating both the noise variance and the number of peaks as hyperparameters based on Bayes free energy, which generally is not analytically tractable. The second step is fitting the parameters of each peak function to the given spectrum by calculating the posterior density, which has a problem of local minima and saddles since multipeak models are nonlinear and hierarchical. Our framework enables the escape from local minima or saddles by using the exchange Monte Carlo method and calculates Bayes free energy via the multiple histogram method. We discuss a simulation demonstrating how efficient our framework is and show that estimating both the noise variance and the number of peaks prevents overfitting, overpenalizing, and misunderstanding the precision of parameter estimation.
△ Less
Submitted 15 December, 2016; v1 submitted 26 July, 2016;
originally announced July 2016.
-
Measurement and comparison of individual external doses of high-school students living in Japan, France, Poland and Belarus -- the "D-shuttle" project --
Authors:
N. Adachi,
V. Adamovitch,
Y. Adjovi,
K. Aida,
H. Akamatsu,
S. Akiyama,
A. Akli,
A. Ando,
T. Andrault,
H. Antonietti,
S. Anzai,
G. Arkoun,
C. Avenoso,
D. Ayrault,
M. Banasiewicz,
M. Banaśkiewicz,
L. Bernandini,
E. Bernard,
E. Berthet,
M. Blanchard,
D. Boreyko,
K. Boros,
S. Charron,
P. Cornette,
K. Czerkas
, et al. (208 additional authors not shown)
Abstract:
Twelve high schools in Japan (of which six are in Fukushima Prefecture), four in France, eight in Poland and two in Belarus cooperated in the measurement and comparison of individual external doses in 2014. In total 216 high-school students and teachers participated in the study. Each participant wore an electronic personal dosimeter "D-shuttle" for two weeks, and kept a journal of his/her whereab…
▽ More
Twelve high schools in Japan (of which six are in Fukushima Prefecture), four in France, eight in Poland and two in Belarus cooperated in the measurement and comparison of individual external doses in 2014. In total 216 high-school students and teachers participated in the study. Each participant wore an electronic personal dosimeter "D-shuttle" for two weeks, and kept a journal of his/her whereabouts and activities. The distributions of annual external doses estimated for each region overlap with each other, demonstrating that the personal external individual doses in locations where residence is currently allowed in Fukushima Prefecture and in Belarus are well within the range of estimated annual doses due to the background radiation level of other regions/countries.
△ Less
Submitted 18 November, 2015; v1 submitted 21 June, 2015;
originally announced June 2015.
-
Belief Propagation for Error Correcting Codes and Lossy Compression Using Multilayer Perceptrons
Authors:
Kazushi Mimura,
Florent Cousseau,
Masato Okada
Abstract:
The belief propagation (BP) based algorithm is investigated as a potential decoder for both of error correcting codes and lossy compression, which are based on non-monotonic tree-like multilayer perceptron encoders. We discuss that whether the BP can give practical algorithms or not in these schemes. The BP implementations in those kind of fully connected networks unfortunately shows strong limita…
▽ More
The belief propagation (BP) based algorithm is investigated as a potential decoder for both of error correcting codes and lossy compression, which are based on non-monotonic tree-like multilayer perceptron encoders. We discuss that whether the BP can give practical algorithms or not in these schemes. The BP implementations in those kind of fully connected networks unfortunately shows strong limitation, while the theoretical results seems a bit promising. Instead, it reveals it might have a rich and complex structure of the solution space via the BP-based algorithms.
△ Less
Submitted 10 March, 2011; v1 submitted 7 February, 2011;
originally announced February 2011.
-
Statistical mechanics of digital halftoning
Authors:
Jun-ichi Inoue,
Yohei Saika,
Masato Okada
Abstract:
We consider the problem of digital halftoning from the view point of statistical mechanics. The digital halftoning is a sort of image processing, namely, representing each grayscale in terms of black and white binary dots. The digital halftoning is achieved by making use of the threshold mask, namely, for each pixel, the halftoned binary pixel is determined as black if the original grayscale pixel…
▽ More
We consider the problem of digital halftoning from the view point of statistical mechanics. The digital halftoning is a sort of image processing, namely, representing each grayscale in terms of black and white binary dots. The digital halftoning is achieved by making use of the threshold mask, namely, for each pixel, the halftoned binary pixel is determined as black if the original grayscale pixel is greater than or equal to the mask value and is determined as white vice versa. To determine the optimal value of the mask on each pixel for a given original grayscale image, we first assume that the human-eyes might recognize the black and white binary halftoned image as the corresponding grayscale one by linear filters. The Hamiltonian is constructed as a distance between the original and the recognized images which is written in terms of the threshold mask. We are confirmed that the system described by the Hamiltonian is regarded as a kind of antiferromagnetic Ising model with quenched disorders. By searching the ground state of the Hamiltonian, we obtain the optimal threshold mask and the resulting halftoned binary dots simultaneously. From the power-spectrum analysis, we find that the binary dots image is physiologically plausible from the view point of human-eyes modulation properties. We also propose a theoretical framework to investigate statistical performance of inverse digital halftoning, that is, the inverse process of halftoning. From the Bayesian inference view point, we rigorously show that the Bayes-optimal inverse-halftoning is achieved on a specific condition which is very similar to the so-called Nishimori line in the research field of spin glasses.
△ Less
Submitted 8 November, 2010;
originally announced November 2010.
-
Statistical Mechanical Study on a Neural Network Model with Time Dependent Interactions
Authors:
T. Uezu,
K. Abe,
S. Miyoshi,
M. Okada
Abstract:
We study a neural network model in which both neurons and synaptic interactions evolve in time simultaneously. The time evolution of synaptic interactions is described by a Langevin equation including a Hebbian learning term, and a bias term which is the interactions of the Hopfield model. We assume that synaptic interactions change much slower than neurons and study the stationary states of syn…
▽ More
We study a neural network model in which both neurons and synaptic interactions evolve in time simultaneously. The time evolution of synaptic interactions is described by a Langevin equation including a Hebbian learning term, and a bias term which is the interactions of the Hopfield model. We assume that synaptic interactions change much slower than neurons and study the stationary states of synaptic interactions by the replica method. We find that the order of the phase transition changes from the second to the first and that the existence regions of the Hopfield attractor and mixed states increase as the coefficient of the learning term increases. We also study the AT stability of solutions and find that the temperature region in which the Hopfield attractor is stable increases as the learning coefficient increases. Theoretical results are confirmed by the direct numerical integration of the Langevin equation. Further, we study the characteristics of the resultant synaptic interactions by partial annealing and find that the stability of the attractor which emerges after partial annealing is enhanced and those of the coexistent attractors are reduced.
△ Less
Submitted 11 March, 2009;
originally announced March 2009.
-
Effect of Slow Switching in On-line Learning for Ensemble Teachers
Authors:
Seiji Miyoshi,
Masato Okada
Abstract:
We have analyzed the generalization performance of a student which slowly switches ensemble teachers. By calculating the generalization error analytically using statistical mechanics in the framework of on-line learning, we show that the dynamical behaviors of generalization error have the periodicity that is synchronized with the switching period and the behaviors differ with the number of ense…
▽ More
We have analyzed the generalization performance of a student which slowly switches ensemble teachers. By calculating the generalization error analytically using statistical mechanics in the framework of on-line learning, we show that the dynamical behaviors of generalization error have the periodicity that is synchronized with the switching period and the behaviors differ with the number of ensemble teachers. Furthermore, we show that the smaller the switching period is, the larger the difference is.
△ Less
Submitted 4 February, 2009; v1 submitted 4 May, 2008;
originally announced May 2008.
-
Statistical Mechanics of Online Learning for Ensemble Teachers
Authors:
Seiji Miyoshi,
Masato Okada
Abstract:
We analyze the generalization performance of a student in a model composed of linear perceptrons: a true teacher, ensemble teachers, and the student. Calculating the generalization error of the student analytically using statistical mechanics in the framework of on-line learning, it is proven that when learning rate $η<1$, the larger the number $K$ and the variety of the ensemble teachers are, t…
▽ More
We analyze the generalization performance of a student in a model composed of linear perceptrons: a true teacher, ensemble teachers, and the student. Calculating the generalization error of the student analytically using statistical mechanics in the framework of on-line learning, it is proven that when learning rate $η<1$, the larger the number $K$ and the variety of the ensemble teachers are, the smaller the generalization error is. On the other hand, when $η>1$, the properties are completely reversed. If the variety of the ensemble teachers is rich enough, the direction cosine between the true teacher and the student becomes unity in the limit of $η\to 0$ and $K \to \infty$.
△ Less
Submitted 20 January, 2006;
originally announced January 2006.
-
Analysis of on-line learning when a moving teacher goes around a true teacher
Authors:
Seiji Miyoshi,
Masato Okada
Abstract:
In the framework of on-line learning, a learning machine might move around a teacher due to the differences in structures or output functions between the teacher and the learning machine or due to noises. The generalization performance of a new student supervised by a moving machine has been analyzed. A model composed of a true teacher, a moving teacher and a student that are all linear perceptr…
▽ More
In the framework of on-line learning, a learning machine might move around a teacher due to the differences in structures or output functions between the teacher and the learning machine or due to noises. The generalization performance of a new student supervised by a moving machine has been analyzed. A model composed of a true teacher, a moving teacher and a student that are all linear perceptrons with noises has been treated analytically using statistical mechanics. It has been proven that the generalization errors of a student can be smaller than that of a moving teacher, even if the student only uses examples from the moving teacher.
△ Less
Submitted 7 September, 2005;
originally announced September 2005.
