shithub: dav1d

Info  •  Files  •  Log  •  Branches

checkasm: decrease cdef filter min damping value

The chroma damping being set to luma damping - 1, we need to decrease
the minimum damping value to ensure a proper clipping test for
clip(0, d - log2(s)).

--- a/tests/checkasm/cdef.c

+++ b/tests/checkasm/cdef.c

@@ -67,7 +67,7 @@

                 memcpy(c_src, src, (10 * 16 + 8) * sizeof(pixel));

                 const int lvl = 1 + (rnd() % 62);

-                const int damping = 3 + (rnd() & 3) + bitdepth_min_8;

+                const int damping = 3 + (rnd() & 3) + bitdepth_min_8 - (w == 4 || (rnd() & 1));

                 const int pri_strength = (lvl >> 2) << bitdepth_min_8;

                 int sec_strength = lvl & 3;

                 sec_strength += sec_strength == 3;