ci: Drop the split Fedora images

Now that we don't need the whole of Pandoc to build our documentation, we can go back to a single Fedora image for our CI.