Skip to main content

All Questions

4 votes
0 answers
442 views

Derivation of k nearest neighbor classification rule

One way to derive the k-NN decision rule based on the k-NN density estimation goes as follows: given $k$ the number of neighbors, $k_i$ the number of neighbors of class $i$ in the bucket, $N$ the ...
diegobatt's user avatar
  • 426
0 votes
1 answer
184 views

How to know which two hyperparameters are more important in SVM, KNN and MLP?

I am trying to limit myself to a maximum two hyper-parameters that are important in KNN, SVM and ...
Kim Zac's user avatar
2 votes
1 answer
520 views

Why is a parametric classifier faster to train than a non-parametric one?

In the tutorial Parametric and Nonparametric Machine Learning Algorithms it says that parametric classifiers are faster than non-parametric classifiers. The reason that non-parametric classifiers are ...
AdiT's user avatar
  • 295
4 votes
1 answer
2k views

Friedman's test to identify best of multiple classifiers on multiple domains

I have several classifiers $f_i\ (i=1, \cdots, N)$ and calculated performance measures on multiple domains $(D)$ for each. Thus, there are $N \times D$ values. I want to find out (increasing ...
Chris's user avatar
  • 599