Don't start the daemons for non-root system users either

Such as gdm and lightdm

See !170 (merged) and https://bugs.debian.org/981089

This was originally suggest 2.5 years ago on the previous merge request, but maybe the impact on GDM wasn't considered then.