Elements triggered by keyboard function key shortcuts not always appearing in Fedora openQA tests since mutter-46.1-2.fc41
In Fedora openQA tests, we have two places that rely on keyboard function key shortcuts that have started breaking since Fedora-Rawhide-20240422.n.0, when mutter-46.1-2.fc41 landed. The two flows are:
- In the loupe test, we download a test image, run loupe (by typing 'image viewer' into the overview and hitting enter), maximize it (with super-up) open the test file (by hitting ctrl-o, clicking the Pictures folder, clicking on the image, and hitting enter), check the image is correctly displayed, then take a snapshot. Two later test steps restore the snapshot, wait a couple of seconds, then press F10. This should open the burger menu.
- In the nautilus test, we download some test files, run nautilus (by typing 'nautilus' in the overview and hitting enter), maximize it, click the button that changes from icon view to list view, check that worked, then take a snapshot. A later test step restores the snapshot, clicks the Documents folder link in the left pane, clicks on a text file that is in that folder, then presses F2. This should open a "rename file" box.
Between mouse clicks, openQA automatically repositions the cursor elsewhere. In the nautilus test it's positioning the cursor to 1023x767 after each click somewhere else, so it's 'click Documents / place at 1023x767 / click text file / place at 1023x767 / press F2'). In the loupe test it's positioning it to 1023x384 after each click (but note all mouse clicks happen before the snapshot save/restore, not sure if the snapshot restore affects it at all).
In both cases, we frequently see the expected interface element (the burger menu or the rename box) not be drawn. It doesn't seem like the shortcut is entirely ignored, though. In the loupe case, the burger menu icon in the main window is highlighted when we hit F10 - but the actual menu does not appear. In the nautilus case, it seems like when the test first clicks the file it is highlighted in light blue with a darker blue border, then when the test presses F2, the darker blue border goes away - but the rename box does not appear.
openQA uses virtio/VNC graphics. I cannot reproduce this manually in a virtio/spice VM; the difference may well be to do with the way openQA teleports the mouse from spot to spot rather than moving it like a human does, we have seen similar cases before, I believe.