It will look more coherent if we keep the border in hover/focus/active states.
Before:
After:
Let's try to summon @jimmac (he told he only ispects issues, but I really don't want open one for this minor thing)
