Draft: implement the color-representation protocol

All the bits and pieces to plumb the information to the correct place and testing.

Shaders implementing the stuff is still missing and the git history is crap.

Based on !2191 (merged) and !3065 (merged).