I just found goto-chg on Melpa which gives you a commands for iterating over the last edit locations.

I just found goto-chg on Melpa which gives you commands for iterating over the last edit locations. If you follow the author's recommendation and provide shortcuts

(global-set-key [(control ?.)] 'goto-last-change)
(global-set-key [(control ?,)] 'goto-last-change-reverse)

then you can move to the last edit location after having scrolled away (accidentially or on purpose).