room-details: Simplify ExtraLists by using GtkFlattenListModel

And fix error where the banned list would appear twice if the invite list is hidden.

Fixes Banned members shown twice in Room Details (#1193 - closed).