shithub: libvpx

Download patch

ref: c098cfdce7fa1efdd5cb27f9db0662dc2e76200e
parent: 5a0242ba5c8fddbf32766bfa2ffbbd25f3cd6167
author: James Zern <jzern@google.com>
date: Tue Sep 10 11:48:04 EDT 2019

vp9_quantize_sse2: quiet clang-7 integer sanitizer warning

nzflag is used as a boolean, it doesn't need to be a sized type, int is
enough (and _mm_movemask_epi8 returns one)

fixes:
vp9_quantize_sse2.c:136:16: implicit conversion from type
'int' of value 65535 (32-bit, signed) to type 'int16_t' (aka 'short')
changed the value to -1 (16-bit, signed)

BUG=webm:1649

Change-Id: I0e3f5278af49d84760f3dfb607f28099cf02f21d

--- a/vp9/encoder/x86/vp9_quantize_sse2.c

+++ b/vp9/encoder/x86/vp9_quantize_sse2.c

@@ -25,7 +25,7 @@

                           const int16_t *iscan) {

   __m128i zero;

   __m128i thr;

-  int16_t nzflag;

+  int nzflag;

   __m128i eob;

   __m128i round, quant, dequant;