-
Learning tensor networks with tensor cross interpolation: new algorithms and libraries
Authors:
Yuriel Núñez Fernández,
Marc K. Ritter,
Matthieu Jeannin,
Jheng-Wei Li,
Thomas Kloss,
Thibaud Louvet,
Satoshi Terasaki,
Olivier Parcollet,
Jan von Delft,
Hiroshi Shinaoka,
Xavier Waintal
Abstract:
The tensor cross interpolation (TCI) algorithm is a rank-revealing algorithm for decomposing low-rank, high-dimensional tensors into tensor trains/matrix product states (MPS). TCI learns a compact MPS representation of the entire object from a tiny training data set. Once obtained, the large existing MPS toolbox provides exponentially fast algorithms for performing a large set of operations. We di…
▽ More
The tensor cross interpolation (TCI) algorithm is a rank-revealing algorithm for decomposing low-rank, high-dimensional tensors into tensor trains/matrix product states (MPS). TCI learns a compact MPS representation of the entire object from a tiny training data set. Once obtained, the large existing MPS toolbox provides exponentially fast algorithms for performing a large set of operations. We discuss several improvements and variants of TCI. In particular, we show that replacing the cross interpolation by the partially rank-revealing LU decomposition yields a more stable and more flexible algorithm than the original algorithm. We also present two open source libraries, xfac in Python/C++ and TensorCrossInterpolation.jl in Julia, that implement these improved algorithms, and illustrate them on several applications. These include sign-problem-free integration in large dimension, the superhigh-resolution quantics representation of functions, the solution of partial differential equations, the superfast Fourier transform, the computation of partition functions, and the construction of matrix product operators.
△ Less
Submitted 4 July, 2024; v1 submitted 2 July, 2024;
originally announced July 2024.
-
Quantics Tensor Cross Interpolation for High-Resolution, Parsimonious Representations of Multivariate Functions in Physics and Beyond
Authors:
Marc K. Ritter,
Yuriel Núñez Fernández,
Markus Wallerberger,
Jan von Delft,
Hiroshi Shinaoka,
Xavier Waintal
Abstract:
Multivariate functions of continuous variables arise in countless branches of science. Numerical computations with such functions typically involve a compromise between two contrary desiderata: accurate resolution of the functional dependence, versus parsimonious memory usage. Recently, two promising strategies have emerged for satisfying both requirements: (i) The quantics representation, which e…
▽ More
Multivariate functions of continuous variables arise in countless branches of science. Numerical computations with such functions typically involve a compromise between two contrary desiderata: accurate resolution of the functional dependence, versus parsimonious memory usage. Recently, two promising strategies have emerged for satisfying both requirements: (i) The quantics representation, which expresses functions as multi-index tensors, with each index representing one bit of a binary encoding of one of the variables; and (ii) tensor cross interpolation (TCI), which, if applicable, yields parsimonious interpolations for multi-index tensors. Here, we present a strategy, quantics TCI (QTCI), which combines the advantages of both schemes. We illustrate its potential with an application from condensed matter physics: the computation of Brillouin zone integrals.
△ Less
Submitted 25 March, 2024; v1 submitted 21 March, 2023;
originally announced March 2023.
-
Nevanlinna.jl: A Julia implementation of Nevanlinna analytic continuation
Authors:
Kosuke Nogaki,
Jiani Fei,
Emanuel Gull,
Hiroshi Shinaoka
Abstract:
We introduce a Julia implementation of the recently proposed Nevanlinna analytic continuation method. The method is based on Nevanlinna interpolants and, by construction, preserves the causality of a response function. For theoretical calculations without statistical noise, this continuation method is a powerful tool to extract real-frequency information from numerical input data on the Matsubara…
▽ More
We introduce a Julia implementation of the recently proposed Nevanlinna analytic continuation method. The method is based on Nevanlinna interpolants and, by construction, preserves the causality of a response function. For theoretical calculations without statistical noise, this continuation method is a powerful tool to extract real-frequency information from numerical input data on the Matsubara axis. This method has been applied to first-principles calculations of correlated materials. This paper presents its efficient and full-featured open-source implementation of the method including the Hamburger moment problem and smoothing.
△ Less
Submitted 19 September, 2023; v1 submitted 21 February, 2023;
originally announced February 2023.
-
Multiscale space-time ansatz for correlation functions of quantum systems based on quantics tensor trains
Authors:
Hiroshi Shinaoka,
Markus Wallerberger,
Yuta Murakami,
Kosuke Nogaki,
Rihito Sakurai,
Philipp Werner,
Anna Kauch
Abstract:
Correlation functions of quantum systems -- central objects in quantum field theories -- are defined in high-dimensional space-time domains. Their numerical treatment thus suffers from the curse of dimensionality, which hinders the application of sophisticated many-body theories to interesting problems. Here, we propose a multi-scale space-time ansatz for correlation functions of quantum systems b…
▽ More
Correlation functions of quantum systems -- central objects in quantum field theories -- are defined in high-dimensional space-time domains. Their numerical treatment thus suffers from the curse of dimensionality, which hinders the application of sophisticated many-body theories to interesting problems. Here, we propose a multi-scale space-time ansatz for correlation functions of quantum systems based on quantics tensor trains (QTT), ``qubits'' describing exponentially different length scales. The ansatz then assumes a separation of length scales by decomposing the resulting high-dimensional tensors into tensor trains (known also as matrix product states). We numerically verify the ansatz for various equilibrium and nonequilibrium systems and demonstrate compression rates of several orders of magnitude for challenging cases. Essential building blocks of diagrammatic equations, such as convolutions or Fourier transforms are formulated in the compressed form. We numerically demonstrate the stability and efficiency of the proposed methods for the Dyson and Bethe-Salpeter equations. {The QTT representation} provides a unified framework for implementing efficient computations of quantum field theories.
△ Less
Submitted 27 April, 2023; v1 submitted 24 October, 2022;
originally announced October 2022.
-
sparse-ir: optimal compression and sparse sampling of many-body propagators
Authors:
Markus Wallerberger,
Samuel Badr,
Shintaro Hoshino,
Fumiya Kakizawa,
Takashi Koretsune,
Yuki Nagai,
Kosuke Nogaki,
Takuya Nomoto,
Hitoshi Mori,
Junya Otsuki,
Soshun Ozaki,
Rihito Sakurai,
Constanze Vogel,
Niklas Witt,
Kazuyoshi Yoshimi,
Hiroshi Shinaoka
Abstract:
We introduce sparse-ir, a collection of libraries to efficiently handle imaginary-time propagators, a central object in finite-temperature quantum many-body calculations. We leverage two concepts: firstly, the intermediate representation (IR), an optimal compression of the propagator with robust a-priori error estimates, and secondly, sparse sampling, near-optimal grids in imaginary time and imagi…
▽ More
We introduce sparse-ir, a collection of libraries to efficiently handle imaginary-time propagators, a central object in finite-temperature quantum many-body calculations. We leverage two concepts: firstly, the intermediate representation (IR), an optimal compression of the propagator with robust a-priori error estimates, and secondly, sparse sampling, near-optimal grids in imaginary time and imaginary frequency from which the propagator can be reconstructed and on which diagrammatic equations can be solved. IR and sparse sampling are packaged into stand-alone, easy-to-use Python, Julia and Fortran libraries, which can readily be included into existing software. We also include an extensive set of sample codes showcasing the library for typical many-body and ab initio methods.
△ Less
Submitted 23 June, 2022;
originally announced June 2022.
-
Efficient ab initio many-body calculations based on sparse modeling of Matsubara Green's function
Authors:
Hiroshi Shinaoka,
Naoya Chikano,
Emanuel Gull,
Jia Li,
Takuya Nomoto,
Junya Otsuki,
Markus Wallerberger,
Tianchun Wang,
Kazuyoshi Yoshimi
Abstract:
This lecture note reviews recently proposed sparse-modeling approaches for efficient ab initio many-body calculations based on the data compression of Green's functions. The sparse-modeling techniques are based on a compact orthogonal basis, an intermediate representation (IR) basis, for imaginary-time and Matsubara Green's functions. A sparse sampling method based on the IR basis enables solving…
▽ More
This lecture note reviews recently proposed sparse-modeling approaches for efficient ab initio many-body calculations based on the data compression of Green's functions. The sparse-modeling techniques are based on a compact orthogonal basis, an intermediate representation (IR) basis, for imaginary-time and Matsubara Green's functions. A sparse sampling method based on the IR basis enables solving diagrammatic equations efficiently. We describe the basic properties of the IR basis, the sparse sampling method and its applications to ab initio calculations based on the GW approximation and the Migdal-Eliashberg theory. We also describe a numerical library for the IR basis and the sparse sampling method, sparse-ir, and provide its sample codes. This lecture note follows the Japanese review article with major revisions [H. Shinaoka et al., Solid State Physics 56(6), 301 (2021)].
△ Less
Submitted 31 August, 2022; v1 submitted 23 June, 2021;
originally announced June 2021.
-
Solving the Bethe-Salpeter equation with exponential convergence
Authors:
Markus Wallerberger,
Hiroshi Shinaoka,
Anna Kauch
Abstract:
The Bethe-Salpeter equation plays a crucial role in understanding the physics of correlated fermions, relating to optical excitations in solids as well as resonances in high-energy physics. Yet, it is notoriously difficult to control numerically, typically requiring an effort that scales polynomially with energy scales and accuracy. This puts many interesting systems out of computational reach. Us…
▽ More
The Bethe-Salpeter equation plays a crucial role in understanding the physics of correlated fermions, relating to optical excitations in solids as well as resonances in high-energy physics. Yet, it is notoriously difficult to control numerically, typically requiring an effort that scales polynomially with energy scales and accuracy. This puts many interesting systems out of computational reach. Using the intermediate representation and sparse modelling for two-particle objects on the Matsubara axis, we develop an algorithm that solves the Bethe-Salpeter equation in $O(L^8)$ time with $O(L^4)$ memory, where $L$ grows only logarithmically with inverse temperature, bandwidth, and desired accuracy, This opens the door for computations in hitherto inaccessible regimes. We benchmark the method on the Hubbard atom and on the multi-orbital weak-coupling limit, where we observe the expected exponential convergence to the analytical results. We then showcase the method for a realistic impurity problem.
△ Less
Submitted 13 August, 2021; v1 submitted 10 December, 2020;
originally announced December 2020.
-
Sparse sampling and tensor network representation of two-particle Green's functions
Authors:
Hiroshi Shinaoka,
Dominique Geffroy,
Markus Wallerberger,
Junya Otsuki,
Kazuyoshi Yoshimi,
Emanuel Gull,
Jan Kuneš
Abstract:
Many-body calculations at the two-particle level require a compact representation of two-particle Green's functions. In this paper, we introduce a sparse sampling scheme in the Matsubara frequency domain as well as a tensor network representation for two-particle Green's functions. The sparse sampling is based on the intermediate representation basis and allows an accurate extraction of the genera…
▽ More
Many-body calculations at the two-particle level require a compact representation of two-particle Green's functions. In this paper, we introduce a sparse sampling scheme in the Matsubara frequency domain as well as a tensor network representation for two-particle Green's functions. The sparse sampling is based on the intermediate representation basis and allows an accurate extraction of the generalized susceptibility from a reduced set of Matsubara frequencies. The tensor network representation provides a system independent way to compress the information carried by two-particle Green's functions. We demonstrate efficiency of the present scheme for calculations of static and dynamic susceptibilities in single- and two-band Hubbard models in the framework of dynamical mean-field theory.
△ Less
Submitted 5 December, 2019; v1 submitted 16 September, 2019;
originally announced September 2019.
-
Sparse sampling approach to efficient ab initio calculations at finite temperature
Authors:
Jia Li,
Markus Wallerberger,
Naoya Chikano,
Chia-Nan Yeh,
Emanuel Gull,
Hiroshi Shinaoka
Abstract:
Efficient ab initio calculations of correlated materials at finite temperature require compact representations of the Green's functions both in imaginary time and Matsubara frequency. In this paper, we introduce a general procedure which generates sparse sampling points in time and frequency from compact orthogonal basis representations, such as Chebyshev polynomials and intermediate representatio…
▽ More
Efficient ab initio calculations of correlated materials at finite temperature require compact representations of the Green's functions both in imaginary time and Matsubara frequency. In this paper, we introduce a general procedure which generates sparse sampling points in time and frequency from compact orthogonal basis representations, such as Chebyshev polynomials and intermediate representation (IR) basis functions. These sampling points accurately resolve the information contained in the Green's function, and efficient transforms between different representations are formulated with minimal loss of information. As a demonstration, we apply the sparse sampling scheme to diagrammatic $GW$ and GF2 calculations of a hydrogen chain, of noble gas atoms and of a silicon crystal.
△ Less
Submitted 20 August, 2019;
originally announced August 2019.
-
SpM: Sparse modeling tool for analytic continuation of imaginary-time Green's function
Authors:
Kazuyoshi Yoshimi,
Junya Otsuki,
Yuichi Motoyama,
Masayuki Ohzeki,
Hiroshi Shinaoka
Abstract:
We present SpM, a sparse modeling tool for the analytic continuation of imaginary-time Green's function, licensed under GNU General Public License version 3. In quantum Monte Carlo simulation, dynamic physical quantities such as single-particle and magnetic excitation spectra can be obtained by applying analytic continuation to imaginary-time data. However, analytic continuation is an ill-conditio…
▽ More
We present SpM, a sparse modeling tool for the analytic continuation of imaginary-time Green's function, licensed under GNU General Public License version 3. In quantum Monte Carlo simulation, dynamic physical quantities such as single-particle and magnetic excitation spectra can be obtained by applying analytic continuation to imaginary-time data. However, analytic continuation is an ill-conditioned inverse problem and thus sensitive to noise and statistical errors. SpM provides stable analytic continuation against noise by means of a modern regularization technique, which automatically selects bases that contain relevant information unaffected by noise. This paper details the use of this program and shows some applications.
△ Less
Submitted 5 April, 2019;
originally announced April 2019.
-
Updated Core Libraries of the ALPS Project
Authors:
Markus Wallerberger,
Sergei Iskakov,
Alexander Gaenko,
Joseph Kleinhenz,
Igor Krivenko,
Ryan Levy,
Jia Li,
Hiroshi Shinaoka,
Synge Todo,
Tianran Chen,
Xi Chen,
James P. F. LeBlanc,
Joseph E. Paki,
Hanna Terletska,
Matthias Troyer,
Emanuel Gull
Abstract:
The open source ALPS (Algorithms and Libraries for Physics Simulations) project provides a collection of physics libraries and applications, with a focus on simulations of lattice models and strongly correlated electron systems. The libraries provide a convenient set of well-documented and reusable components for developing condensed matter physics simulation codes, and the applications strive to…
▽ More
The open source ALPS (Algorithms and Libraries for Physics Simulations) project provides a collection of physics libraries and applications, with a focus on simulations of lattice models and strongly correlated electron systems. The libraries provide a convenient set of well-documented and reusable components for developing condensed matter physics simulation codes, and the applications strive to make commonly used and proven computational algorithms available to a non-expert community. In this paper we present an update of the core ALPS libraries. We present in particular new Monte Carlo libraries and new Green's function libraries.
△ Less
Submitted 19 November, 2018;
originally announced November 2018.
-
Efficient implementation of the continuous-time interaction-expansion quantum Monte Carlo method
Authors:
Hiroshi Shinaoka,
Yusuke Nomura,
Emanuel Gull
Abstract:
We describe an open-source implementation of the continuous-time interaction-expansion quantum Monte Carlo method for cluster-type impurity models with onsite Coulomb interactions and complex Weiss functions. The code is based on the ALPS libraries.
We describe an open-source implementation of the continuous-time interaction-expansion quantum Monte Carlo method for cluster-type impurity models with onsite Coulomb interactions and complex Weiss functions. The code is based on the ALPS libraries.
△ Less
Submitted 13 July, 2018;
originally announced July 2018.
-
irbasis: Open-source database and software for intermediate-representation basis functions of imaginary-time Green's function
Authors:
Naoya Chikano,
Kazuyoshi Yoshimi,
Junya Otsuki,
Hiroshi Shinaoka
Abstract:
The open-source library, irbasis, provides easy-to-use tools for two sets of orthogonal functions named intermediate representation (IR). The IR basis enables a compact representation of the Matsubara Green's function and efficient calculations of quantum models. The IR basis functions are defined as the solution of an integral equation whose analytical solution is not available for this moment. T…
▽ More
The open-source library, irbasis, provides easy-to-use tools for two sets of orthogonal functions named intermediate representation (IR). The IR basis enables a compact representation of the Matsubara Green's function and efficient calculations of quantum models. The IR basis functions are defined as the solution of an integral equation whose analytical solution is not available for this moment. The library consists of a database of pre-computed high-precision numerical solutions and computational code for evaluating the functions from the database. This paper describes technical details and demonstrates how to use the library.
△ Less
Submitted 4 February, 2019; v1 submitted 13 July, 2018;
originally announced July 2018.
-
Updated Core Libraries of the ALPS Project
Authors:
A. Gaenko,
A. E. Antipov,
G. Carcassi,
T. Chen,
X. Chen,
Q. Dong,
L. Gamper,
J. Gukelberger,
R. Igarashi,
S. Iskakov,
M. Könz,
J. P. F. LeBlanc,
R. Levy,
P. N. Ma,
J. E. Paki,
H. Shinaoka,
S. Todo,
M. Troyer,
E. Gull
Abstract:
The open source ALPS (Algorithms and Libraries for Physics Simulations) project provides a collection of physics libraries and applications, with a focus on simulations of lattice models and strongly correlated systems. The libraries provide a convenient set of well-documented and reusable components for developing condensed matter physics simulation code, and the applications strive to make commo…
▽ More
The open source ALPS (Algorithms and Libraries for Physics Simulations) project provides a collection of physics libraries and applications, with a focus on simulations of lattice models and strongly correlated systems. The libraries provide a convenient set of well-documented and reusable components for developing condensed matter physics simulation code, and the applications strive to make commonly used and proven computational algorithms available to a non-expert community. In this paper we present an updated and refactored version of the core ALPS libraries geared at the computational physics software development community, rewritten with focus on documentation, ease of installation, and software maintainability.
△ Less
Submitted 15 December, 2016; v1 submitted 13 September, 2016;
originally announced September 2016.
