Draft: build: Allow to disable x11

With mutter!3776, it would be possible to build Mutter without x11. I thought of giving a try, enough to get the build to pass.

More changes are probably needed but I will update later and remove the draft status if it is something we might find useful.