My totally westener brain is hardwired to think of it the same way I
read text: top-left to bottom-right. The current allocation code goes
top-bottom and left-right, and that's making me think of it wrongly
way too many times.

Allocate top-left to bottom-right through each column then row.