This was caused due to a reference cycle with GeditAppActivatable.
Also report a debug message if the GeditApp is leaked.