1
$\begingroup$

A minimum ECM classifier disciminate the features $\underline{x}$ to belong to class $t$ ($\delta(\underline{x}) = t$) if $\forall j \ne t$: $$\sum_{k\ne t} c(t|k) f_k(\underline{x})p_k \le \sum_{k\ne j} c(j|k) f_k(\underline{x})p_k $$

Bayes classifiers can be used even when cost of misclassification must be considered in the problem, using some tricks to include the informatino of the cost into the priors. For instance if the cost of misclassification depends only on the true group that I'm attributing the unit to (so we have $ c(j|k)=c_k$), by defining as priors $\pi_k = c_k p_k / \sum_{s}c_sp_s$ the rule for classification becomes:

$$\sum_{k\ne t} \pi_k f_k(\underline{x}) \le \sum_{k\ne j} \pi_k f_k(\underline{x})$$

Thus obtaining a Bayes classifiers.

However, I know that bayes classifiers can still be used if the cost of misclassification depends only on the group misclassified: $c(t|k) = c_t $, or even when $c(t|k) = \alpha^t \beta^k$. I was not able to find the expression for the Bayes classifiers in those two cases, was wondering if anyone already worked on it or may have some hint.

$\endgroup$

1 Answer 1

0
$\begingroup$

For binary classification can be easily derived as, since the classification rule for class 1 is: $$c(1|2) f_2(\underline{x})p_2 \le c(2|1) f_1(\underline{x})p_1 $$ $$c_1 f_2(\underline{x})p_2 \le c_2 f_1(\underline{x})p_1 $$ To guarantee that the swapping will not change sign, we normalize first the costs: $$\frac{c_1 f_2(\underline{x})p_2}{c_1+c_2} \le \frac{c_2 f_1(\underline{x})p_1}{c_1+c_2} $$

$$ \frac{f_2(\underline{x})p_2}{c_2}(c_1+c_2) \le \frac{f_1(\underline{x})p_1}{c_1}(c_1+c_2) $$

Therefore the modified priors are: $$π_1 = \frac{p_1(c_1+c_2)}{c_1} \hspace{1 cm} and \hspace{1 cm} π_2 = \frac{p_2(c_1+c_2)}{c_2} $$

Normalization: $$π_1 = \frac{\frac{p_1(c_1+c_2)}{c_1} } {\frac{p_1(c_1+c_2)c_2 + p_2(c_1+c_2)c_1}{c_1c_2}} = \frac{p_1(c_1+c_2)}{c_1}\frac{c_1c_2}{p_1(c_1+c_2)c_2+p_2(c_1+c_2)c_1} = \frac{c_2p_1}{p_1c_2+p_2c_1}$$

$$π_2 = \frac{c_1p_2}{p_1c_2+p_2c_1}$$

$\endgroup$

Not the answer you're looking for? Browse other questions tagged or ask your own question.