Skip to main content

All Questions

44 votes
4 answers
69k views

What exactly is the difference between a parametric and non-parametric model?

I am confused with the definition of non-parametric model after reading this link Parametric vs Nonparametric Models and Answer comments of my another question. Originally I thought "parametric vs ...
Haitao Du's user avatar
  • 37.2k
37 votes
4 answers
49k views

What is the weak side of decision trees?

Decision trees seems to be a very understandable machine learning method. Once created it can be easily inspected by a human which is a great advantage in some applications. What are the practical ...
Łukasz Lew's user avatar
  • 1,412
53 votes
9 answers
3k views

Are all models useless? Is any exact model possible -- or useful?

This question has been festering in my mind for over a month. The February 2015 issue of Amstat News contains an article by Berkeley Professor Mark van der Laan that scolds people for using inexact ...
Russ Lenth's user avatar
  • 20.8k
3 votes
0 answers
205 views

Parametric vs non-parametric machine learning methods [duplicate]

I looked-up many references and websites and researched on how to determine if a method is between parametric or non-parametric. I came up with below definitions, A parametric algorithm has a fixed ...
M.Hossein Rahimi's user avatar
8 votes
1 answer
1k views

Nonparametric nonlinear regression with prediction uncertainty (besides Gaussian Processes)

What are state-of-the-art alternatives to Gaussian Processes (GP) for nonparametric nonlinear regression with prediction uncertainty, when the size of the training set starts becoming prohibitive for ...
lacerbi's user avatar
  • 5,226
8 votes
2 answers
2k views

Bayesian nonparametric answer to deep learning?

As I understand it, deep neural networks are performing "representation learning" by layering features together. This allows learning very high dimensional structures in the features. Of course, it's ...
cgreen's user avatar
  • 1,002
1 vote
1 answer
258 views

Does a non-parametric model necessarily have zero bias?

For a parametric model like linear regression, the bias is often interpreted as "the parameters & architecture you chose are inappropriate for the shape of this dataset". For (one ...
kennysong's user avatar
  • 1,061
1 vote
0 answers
23 views

Why is "consistent nearest neighbour" Non-parametric? [duplicate]

Definition of "Consistent nearest neighbour", runs our usual KNN classifier but instead of viewing k as a hyper-parameter it always sets k = ceil[log(n)]. So far, I looked-up many references and ...
M.Hossein Rahimi's user avatar