Now that we don't check for icons on desktop, there is no need for a
separate "if" block.

Instead, make it closer to equivalent code in gtk/gtkbookmarksmanager.c