$\Delta U = -(W_{earth} + W_{ball})$
$W_{ball}$ is almost 0, as earth's displacement by the falling ball is super small, so $\Delta y$ of the earth could be negligible and $W_{ball} = 0$. so:
$\Delta U = -(W_{earth})$
$U_{f} - U{i} = -(mg(y_f - y_i))$
When object falls down from 100m to 80m, $y_f - y_i$ is negative. The negative sign of this cancel the negative sign in the start of the equation, so we're left with:
now, type in 100 and 80, and we will get $20mg$ which seems change in potential energy appeared positive. It should be negative though as it decreased from 100m to 80m.