remote-display-factory: Don't be so noisy about non-remote displays

GdmRemoteDisplayFactory assumes the displays added and removed are remote displays, and gives a warning in the log if that assumption fails.

But the remote display factory and local display factory share a display store, so that assumption will fail...

This commit changes the g_return_if_fail calls to if () return;