Use new scroll_to() API

I don't think this fixes any bug, but it allows for better code.

I'm sure there are new interesting things to be done with this API, but for now I've only on cleaning up our hacks.

Also related to the series of MRs aligned to the plans in #3042 (closed)