This removes `GtkListBox`s that were used to list the users we were
going to send invites to. But since we keep inline the search input now,
they are not useful anymore.

See #78