[43] ci: Temporarily disable aarch64 test
From: @rmader
The runners constantly time out for the last two days.
Part-of: !3135 (merged)
(cherry picked from commit c45d0301)
(cherry picked from commit 11f54dcf)
As suggested by @jadahl in !3191 (comment 1821928)