test_builder_with_handler_object fails with gnome master

Needs investigating: https://gitlab.gnome.org/GNOME/pygobject/-/jobs/174234