Revert "backends: Don't include damage history in swap region"

This reverts commit a82dd686.

It causes severe issues in multi monitor setups - lets back out for now and reland a fixed version later.