Questions tagged [bayesian-probability]
The bayesian-probability tag has no usage guidance.
86
questions
1
vote
1
answer
115
views
The expectation of binary logistics regression with respect to Gaussian distribution
I am trying to compute the expectation of $g(s,x)=s \ln \sigma(x)+(1-s)\ln(1-\sigma(x))$ with respect to the normal distribution $\mathcal{N}(x;m,v)$, where we have $\sigma(x)=\frac{1}{1+e^{-x}}$. If ...
- 37
2
votes
1
answer
732
views
Bayesian methods in online setting
Imagine the following (very concrete) model: We have a series of random variables $x_k$ with values in $\lbrace 0, 1\rbrace$. We assume $x_k \mid p_k \sim \operatorname{Alt}(p_k),$ where $p_0 \sim R(0,...
- 151
1
vote
0
answers
64
views
Bayesian parameter estimation
I am generally not that knowledgeable for math, so if my question is too broad or inaccurate, please let me know.
I am currently reading a paragraph of one paper (https://www.fil.ion.ucl.ac.uk/spm/...
0
votes
1
answer
160
views
Shannon problem
Since a few days, I try in my research to model / formalize a source of Shannon a little weird, and I can't do it at all. First of all, I explain to you its operating principle and then I describe it ...
- 83
3
votes
1
answer
418
views
Updating Geman and Geman (1984) on image restoration
I am reading the seminal paper
Stuart Geman and Donald Geman, Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images, IEEE Transactions on Pattern Analysis and Machine ...
- 75
0
votes
1
answer
122
views
How to infer the eigenvalue distribution from matrix where each entry has a known Gaussian distribution?
Problem
Given $X \in \mathbb{R}^{n \times n}$ where $X_{ij} \sim \mathcal{N}(\mu_{ij}, \sigma_{ij}^2 I)$
Find the marginal distribution of each eigenvalue, using whatever you can.
Background
In my ...
6
votes
0
answers
202
views
Existence of stick breaking representations for random measures
The Dirichlet process has a roughly size ordered representation in terms of beta random variables, called a stick-breaking representation (Sethuraman, 1994). Similar results hold for the beta process, ...
- 129
2
votes
2
answers
522
views
Quantifying the effect of noise on the posterior variance in Gaussian processes / multivariate Gaussian vectors
Consider a real-valued Gaussian process $f$ on some compact domain $\mathcal{X}$ with mean zero and covariance function $k(x,x') \in [0,1]$ (also known as the kernel function). This question concerns ...
- 315
1
vote
0
answers
47
views
RMHMC sampling in non-parametric setup
The aim is to sample distributions using Fisher information (as mass matrix in Hamiltonian MCMC sampling). Details can be found in http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.190.580&...
- 157
1
vote
1
answer
75
views
A problem with elementary inequality involving probabilities and Brier scoring rule
I am trying to prove certain relations between certain values of the so called Brier inaccuracy measure (Brier scoring rule).
Given a vector $p = (p_1, \ldots p_n)$, where $p_1 + \ldots p_n = 1$ and $...
- 135
0
votes
1
answer
170
views
Learning a Gaussian from noisy observations
Is it possible to learn a distribution over the parameters ($K=\Sigma^{-1}$ and $\mu$) of a Gaussian from noisy measurements of $X$? (Starting with some appropriate prior over the parameters)
I know ...
- 121
3
votes
2
answers
421
views
Multivariate normal concentration
If $X\sim N(0,\Sigma)$ for some $d$-dimensional normal distribution, then $X = \Sigma^{1/2} Z$ where $Z\sim (0,I)$. How to compute the following quantity?
$$
\operatorname{var} (X^T X)
=
\...
- 719
1
vote
1
answer
118
views
Accounting for unobserved events in baysian learning
I wanted to use Bayes theorem to help me automate the task of deciding if I should ignore events, but I am not sure how to update the posterior if I do
The simple story goes like this:
An event $y_i$...
- 213
1
vote
1
answer
344
views
convergence of Bayesian posterior with non iid data
Let $(\epsilon_t)_t$ be a sequence of iid random variables, distributed according to the density $f:\mathbb{R}\to (0,\infty)$ and
$$
x_t = q( \theta^\star, x_1,x_2, \ldots, x_{t-1}) + \epsilon_t \,.
...
- 355
1
vote
0
answers
46
views
Bounding Hidden Markov model Bayesian filter error with inexact models
In context of a hidden Markov model, I am interested in bounding the error of a Bayesian filter when using inexact state transition and observation models.
Consider a hidden Markov model (HMM) with ...
- 171