Do not try to cache .flatpak-builder/cache, it just does not work

Gitlab zips its target which causes ostree to brake.

Making a tarball first also does not seem to work.

Instead we can try to cache the git and download sources