An application window has a different title compared to the name in the desktop file
Just switched to GNOME 44, and I can see that the pin in the dash is called "System Monitor", whereas an application window's title is "GNOME System Monitor". I believe this causes the application to appear twice in the Dash: