0
$\begingroup$

I'm interested in the Gaussian density, truncated vertically at a threshold $\beta>0$.

$$ p(x)=\frac{1}{Z} \min\left\{\exp\Big(-\frac{1}{2}(x-\mu)^T\Sigma^{-1}(x-\mu)\Big),\beta\right\} \\ $$

How can I find the normalizing constant $Z$?

Graph of vertically truncated normal density function

$\endgroup$

1 Answer 1

1
$\begingroup$

You won't be able to find this constant in a nice form. Either you have an integral experession or a numerical approximation.

I assume (like usual for a gaussian densitiy) $\Sigma \in \Bbb R ^{n\times n}$ to be positive definite and so we can conclude that $$\exp\Big(-\frac{1}{2}(x-\mu)^T\Sigma^{-1}(x-\mu)\Big) \le 1$$ hold.

Then for $\beta \ge 1$ we are getting a normal gaussian density for p(x) and can conclude $$Z = \sqrt{(2\pi)^n \det(\Sigma)}$$

For a shorter notation consider that with $$\begin{align*} <x,y> &= x^T\Sigma^{-1}y \\ ||x|| &= \sqrt{<x,x>}\end{align*}$$

we can write $$p(x)=\frac{1}{Z} \min\left\{\exp\Big(-\frac{1}{2}||x-\mu||^2\Big),\beta\right\}$$

For $0 < \beta < 1$ and $A:=\left\{ x \in \Bbb R^n \;\Big|\; ||x-\mu|| \ge \sqrt{-2\ln\beta}\right\}$ we have:

$$\begin{align*} Z &= \int_{\Bbb R^n} Zp(x) dx \\ &= \int_{A} \exp\Big(-\frac{1}{2}||x-\mu||^2\Big) dx + \int_{A^c} \beta dx \\ &= \sqrt{(2\pi)^n \det(\Sigma)} - \int_{A^c} \exp\Big(-\frac{1}{2}||x-\mu||^2\Big) - \beta \, dx \end{align*}$$

For a given $\Sigma$ you may be able to calculate $$\int_{A^c} \beta \, dx$$

but the expression

$$\int_{A^c} \exp\Big(-\frac{1}{2}||x-\mu||^2\Big) \, dx$$ have to be calculated numerically, even in the real case.

For some $\beta$ this can be simplified but not in the general case.

$\endgroup$
3
  • $\begingroup$ Thank you, that is very helpful. What is the c in the superscript of A? I'm wondering which special cases of beta would allow for a simplification. Also, would it help to define beta in terms of the variance of the original Gaussian? $\endgroup$
    – danijar
    Commented Jun 15, 2018 at 14:51
  • $\begingroup$ $A^c$ means the complement of $A$, often also written as $\overline{A}$.... so it holds $$A^c =\left\{ x \in \Bbb R^n \;\Big|\; ||x-\mu|| < \sqrt{-2\ln\beta}\right\}$$ Just ignore my last sentence in the posting… when written had $\beta = 0$ in mind but ofc this makes no sense here.... And: No it makes no difference if $\beta$ is defined in terms of the variance because for each $\beta$ it holds $$\int_{A^c} \beta \, dx = \beta \int_{A^c} 1 \, dx = \beta \lambda(A^c)$$ where $\lambda$ denotes the Lebesgue measure and so $\beta$ is just a normal factor and nothing to handle. $\endgroup$
    – Gono
    Commented Jun 15, 2018 at 18:06
  • $\begingroup$ That's interesting, thanks. $\endgroup$
    – danijar
    Commented Jun 15, 2018 at 23:02

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .