Questions tagged [learning-theory]
This tag is used for questions that are related with following branches: Statistical learning theory, Machine learning, Vapnik–Chervonenkis theory (VC theory) and all other branches that are studied and applied in the area of learning theory that involves various kinds of mathematics.
100
questions
1
vote
0
answers
124
views
Vertex cover for hamming graphs representing sets of bounded VC dimension
Let $S$ be a set of binary vectors (in $\lbrace 0,1 \rbrace^m $) whose VC dimension is $d$. Let $H$ be the Hamming graph generated from this set where each node represents a binary vector and two ...
0
votes
0
answers
548
views
VC dimension and boolean hypercube subgraphs
Are there any well studied graph theoretic properties that are common to all subgraphs of the boolean hypercubes that have a given VC dimension d.
3
votes
2
answers
2k
views
Vapnik-Chervonenkis dimension of lines in the plane
I'm having some problems with this problem concerning VC dimensions (http://en.wikipedia.org/wiki/VC_dimension), I hope for some helping input.
Given a set $L$ of $n$ lines in the plane, define a ...
4
votes
2
answers
3k
views
Monotonicity of the hard EM algorithm.
Consider the problem where we want to find a maximum likelihood estimate of $\theta$, given $X$ and $$P_\theta(Y) = \sum_z P_\theta(Y,x)$$ where $x$ is a latent variable.
I know that the soft EM ...
2
votes
0
answers
858
views
Classical Multidimensional Scaling
Hi,
I am doing an MDS with a distance matrix coming from geodesic distances between points X on a 3d mesh (ie., not euclidean distances), and try to find points Y in euclidean space which best ...
10
votes
4
answers
3k
views
Reference request for manifold learning
I am interested in learning about manifold learning (no pun intended) and would like to know of some references that discuss the subject from a more geometric perspective. By manifold learning I mean ...
2
votes
5
answers
5k
views
Nodes clusters with a distance matrix
Hi,
I have a (symmetric) matrix $M$ that represents the distance between each pair of nodes. For example,
A B C D E F G H I J K L
A 0 20 20 20 40 60 60 60 100 120 ...
2
votes
3
answers
14k
views
The Polynomial Kernel
I Have seen two versions of the Polynomial Kernel during my time learning Kernel Methods for things such as regression analysis.
1) $\kappa_d(x,y) = (x \cdot y)^d$
2) $\kappa_d(x,y) = (x \cdot y + 1)...
2
votes
1
answer
100
views
Ranking sources at variable(random) frequencies
Hi,
I have this math modeling problem that I need help with. If I have 3 data sources, each being updated at different frequencies, what would be the best way to rank them so the less frequent ...
10
votes
3
answers
400
views
disconnected or poorly connected graphs in sport ratings systems
I've briefly read about rating systems that provide rankings to players based only on their performance wrt other players, in the context of chess. (for example, elo). When there is a lot of ...