gtkscrollbar: Fix oscillating when hovered at the right place

Julian Sparberrequested to merge
jsparber/gtk:fix_scrollbar_oscillating into main

Fixes: #4938

Merge request reports