gitlab-ci: fix crossroad caching.

This should hopefully speed up successive builds as most packages don't need to be re-downloaded.

More experimentations to come, so that we can improve a bit the CI builds.