Try to make some tests less flaky

Seems the the two most common flaky tests are restore-size and timeline-interpolate. This MR tries to improve the situation a bit with those.

Lets see if it makes any difference.