Commit 5b2c7dd4 authored by Ell's avatar Ell

transform: round numerical errors in transformation matrix

In the transform ops, round numerical errors in the generated
matrix to the nearest integer.  This is especially important when
using the NEAREST sampler, which is sensitive to boundary
conditions.

In particular, a perfect 90-deg rotation matrix cannot be generated
naively using the trigonometric functions (since there is no double
x such that cos(x) = 1 exactly), which can cause a single row or
column to be missing from the output in some cases.
parent ddbeefcd
Pipeline #195224 passed with stages
in 27 minutes and 29 seconds