ScrolledWindow expands when scrollbar gets hovered

Just noticed this in widget-factory, but didn't investigate further:

Observe both the textview and the text styles list are growing and pushing the widgets above them upwards when the mouse moves over the scrollbars.

That should not happen.