Currently this label (and any other involving numbers) jumps when the numbers change. This can be prevented by using tabular figures, which essentially makes digits monospace.
It can be done as follows in gtkbuilder xml:
<attribute name="font-features" value="tnum=1"/>