This allows to reduce the testsuite completion time from almost 3 minutes to
about 3s.

This however showed that we were not waiting for the application to
terminate. Add terminate_app() which ensures this, to be used instead of
only killing the application.