All Questions
53
questions
1
vote
0
answers
129
views
Estimator for the conditional expectation operator with convergence rate in operator norm
Let $X$ and $Z$ be two random variables defined on the same probability space, taking values in euclidian spaces $E_X$ and $E_Z$, with distributions $\pi$ and $\nu$, respectively.
Let $L^2(\pi)$ ...
- 111
0
votes
1
answer
58
views
Given positive $\epsilon$ and $c$, find a density $\phi$ such that $t\phi(\epsilon/t) \ge c \|\phi'\|_\infty$ for all positive $t$
A nice density (on $\mathbb R$) is function $\phi:\mathbb R \to \mathbb R$ such that
(1) $\phi(x) \ge 0$ for all $x \in \mathbb R$,
(2) $\int_{-\infty}^\infty \phi(x) \mathrm{d}x = 1$,
(3) $\phi$ is ...
- 6,824
2
votes
2
answers
225
views
Minimal conditions on random vector $X \in R^n$ to ensure that $\lim_{t\to 0^+}\sup_{\|w\|_p = 1}\sup_{u \in \mathbb R}\mathbb P(|X'w-u| \le t)=0$
Let $X$ be a random variable on $\mathbb R^n$ and let $S_p^n := \{w \in \mathbb R^n \mid \|w\|_p = 1\}$ be the unit-sphere w.r.t to the $\ell_p$-norm in $\mathbb R^n$. We will be particularly ...
- 6,824
0
votes
1
answer
306
views
Deduce that a function is zero on interval $[0,M]$
I have been thinking about this for the last few days but I was not able to produce a definitive answer.
Take an integrable function $g$ that maps in $\mathbb{R}$ and with domain contained in $[0,M]$ (...
- 131
1
vote
1
answer
163
views
Tight upper-bounds for the Gaussian width of intersection of intersection of hyper-ellipsoid and unit-ball
Let $\Lambda$ be a positive-definite matrix of size $n$ and let $R \ge 0$, which may depend on $n$. Consider the set $S := \{x \in \mathbb R^n \mid \|x\|_2 \le R,\,\|x\|_{\Lambda^{-1}} \le 1\}$ where $...
- 6,824
5
votes
2
answers
2k
views
Relationship between KL, chi-squared, and Hellinger
There are many well-known relationships between the KL divergence, chi-squared ($\chi^2$) divergence, and the Hellinger metric. In the paper "Assouad, Fano, and Le Cam" by Bin Yu, the author ...
- 63
1
vote
0
answers
368
views
Conditions for equivalence of RKHS norm and $L^2(P)$ norm
Let $K$ be a psd kernel on an abstract space $X$ and let $H_K$ be the induced Reproducing Kernel Hilbert Space (RKHS). Let $P$ be a probability measure on $X$ such that $H_K \subseteq L^2(P_X)$ and ...
- 6,824
1
vote
0
answers
95
views
$L_1$ convergence rates for multivariate kernel density estimation
Let $X$ be a random variable on $\mathbb R^d$ with probability density function $f$, and let $X_1,\ldots,X_n$ of $X$ be $n$ iid copies of $X$. Given a bandwidth parameter $h=h_n > 0$ and a kernel $...
- 6,824
4
votes
0
answers
161
views
Convergence rates for kernel empirical risk minimization, i.e empirical risk minimization (ERM) with kernel density estimation (KDE)
Let $\Theta$ be an open subset of some $\mathbb R^m$ and let $P$ be a probability distribution on $\mathbb R^d$ with density $f$ in a Sobolev space $W_p^s(\mathbb R^d)$, i.e all derivatives of $f$ ...
- 6,824
2
votes
0
answers
118
views
Consistent approximation of weighted Radon transform of smooth probability density, using kernel density estimation
Let $X$ be a random vector in $\mathbb R^d$, with "sufficiently smooth" probability density function on $\rho$. For unit-vectors $w$ and $u$ in $\mathbb R^d$, and a scalar $b \in \mathbb R$, ...
- 6,824
4
votes
1
answer
113
views
Consistent empirical estimation of Radon transform of a multivariate density function
Let $P$ be a "nice" distribution on $\mathbb R^m$ (e.g., multivariate Gaussian, etc.), with density $p$. Let $H := \{x \in \mathbb R^m \mid x^\top w = b\}$ be a hyperplane in $\mathbb R^m$ ...
- 6,824
3
votes
0
answers
540
views
Eigenvalues of Matérn covariance function
Recall that Matérn covariance function $C_\nu(d)$ is defined as
$$
C_\nu(d)=\sigma^2\frac{2^{1-\nu}}{\Gamma(\nu)}\left(\sqrt{2\nu}\frac{d}{\rho}\right)^\nu K_\nu\left(\sqrt{2\nu}\frac{d}{\rho}\right), ...
- 377
0
votes
0
answers
91
views
Empirical estimation of Brenier map from data
Let $f:\mathbb R^d \to \mathbb R$ be a "nice" (say, continuous) function define $A = A_f := \{x \in \mathbb R^d \mid f(x) \ge 0\}$ and $B =B_f:= \{x \in \mathbb R^d \mid f(x) \le 0\}$, and ...
- 6,824
1
vote
0
answers
228
views
Variance-based localized Rademacher complexity for RKHS unit-ball
Let $\mathscr X$ be a compact subset of $\mathbb R^d$ (e.g the unit-sphere). Let $K: \mathscr X \times \mathscr X \to \mathbb R$ be a positive kernel function and let $\mathscr H_K$ be the induced ...
- 6,824
1
vote
0
answers
64
views
Normalizing constants preserve metric entropy
Suppose $\mathcal{F}=\left\{f\in L^2([a,b]): 0<\underline{c}\leq f\leq\overline{c} \right\}$. Consider the following transformation
$$\tilde{\mathcal{F}} := \left\{\frac{f}{\int f d\mu}: f\in \...
- 11