ports: Move GCC patches to upstream

See the commit message.

Also, the changes in patch-babl-linker-fix-darwin.diff seems wrong. They need to be upstreamed in a proper way compatible with all OSes.