Handle empty invalidations

Store empty invalidations in the buffer age accounting, as we still do swap buffers on monitors that did not repaint.

Also, fix invalidation for the situations where we don't have buffer age.