Questions tagged [logsumexp]
The logsumexp tag has no usage guidance.
7
questions
3
votes
0
answers
32
views
What are the "tricks" in machine learning? [closed]
I have come across a few different "tricks" in machine learning methodology, which I list below along with my rudimental understandings.
The Kernel Trick:
This is used in Support Vector ...
- 409
2
votes
1
answer
79
views
How to do log subtract (just like logsumexp) with probabilities? [closed]
To subtract a small probability from another, this answer has constraint on log probabilities l1 > l2: Subtracting very small probabilities - How to compute? but I need a function that works for ...
- 201
3
votes
1
answer
128
views
Dummy variables in regression with log-transformed continous variables
I have a question dealing with logarithmic variables, log-sum and dummy variables in a multiple regression.
First of all I’ve never worked with log-sums before.
I have a model with y that is log-...
- 31
3
votes
1
answer
183
views
parallelizing log-sum-exp
I have some approximate likelihoods: $L_1, \ldots, L_n$. Each is quite expensive to calculate. They're approximate because they use random numbers. Each of them is being calculated on the same data ...
- 21.2k
8
votes
3
answers
1k
views
log(1 - softmax(X))? [closed]
Let $\vec X$ be a vector. The $\vec V = \mathrm{logsoftmax}(\vec{X})$ function is defined as:
$$v_i = \ln\left(\frac{e^{x_i}}{\sum_i e^{x_i}}\right)$$
This is provided in machine learning numerical ...
- 4,440
3
votes
1
answer
1k
views
Vectorised computation of logsumexp
In this related post there is an explanation of how you can add together two very small probabilities using the logsumexp function, and how this can be programmed into base ...
- 129k
3
votes
1
answer
2k
views
What is the use of the log of the sum of exponents in machine learning
I want to understand why somebody would use log sum exponent trick.
I am reading this blog.
But I don't really understand the first paragraph.
It says
Let's say we have an n-dimensional ...
- 131