All Questions
7
questions
1
vote
0
answers
171
views
Projection pursuit regression
Projection pursuit regression (PPR) is described in Hastie et al.'s The Elements of Statistical Learning in the chapter on neural networks. The algorithm was introduced by Friedman and Stuetzle (1981)....
- 751
5
votes
1
answer
2k
views
Is it possible to use variational autoencoders with Non-Gaussian data?
I am dealing with two scenarios: 1) Non-Gaussian data distribution and 2) non-stationary data).
First, I am planning to use a variational autoencoder for modeling the probability distribution of the ...
- 333
2
votes
1
answer
56
views
Quantifying importance of a parameter in neural networks' prediction
Say I'm given a neural network, parameterized by a $d$-dimensional vector $\theta$, and an input $x$.
Given the prediction of this model $f_{\theta}(x)$, can I somehow quantify importance of each of $...
- 213
4
votes
1
answer
1k
views
Can someone explain why neural networks are highly parameterized?
I understand that neural networks by definition, are a parametric model.
If I am correct, Parametric methods make an assumption about the functional form, or shape, of f. For a neural network, what ...
- 71
44
votes
4
answers
69k
views
What exactly is the difference between a parametric and non-parametric model?
I am confused with the definition of non-parametric model after reading this link Parametric vs Nonparametric Models and Answer comments of my another question.
Originally I thought "parametric vs ...
- 37.2k
0
votes
0
answers
402
views
Non-parametric non-linear regression with deep learning
I have a situation where I have an increasing list of real numbers $\vec a$ of variable length (generally about 50 numbers but sometimes more). It turns out that these numbers uniquely correspond to ...
- 3,152
8
votes
2
answers
2k
views
Bayesian nonparametric answer to deep learning?
As I understand it, deep neural networks are performing "representation learning" by layering features together. This allows learning very high dimensional structures in the features. Of course, it's ...
- 1,002