correctly offset the mask,
don't crash computing the histogram of a GRAY image selection
and don't use an integer division