Daniel Jalkut 0f6780b9a3 lexer: pass code-unit length to U16_NEXT in UTF-16 decoders ... `ts_decode_utf16_le` and `ts_decode_utf16_be` passed a byte length to `U16_NEXT_LE` and `U16_NEXT_BE`, but those macros count `uint16_t` code units. If a lead surrogate was the last code unit in a chunk, the decoder could peek past the chunk and combine it with adjacent memory. This commit passes the code-unit length to the UTF-16 macros, and fails with `TS_DECODE_ERROR` when a chunk is too short to contain even one full code unit. This lets the lexer retry with a fresh chunk or advance through the invalid byte as it already does. Co-authored-by: Will Lillis <will.lillis24@gmail.com> Co-authored-by: Amaan Qureshi <git@amaanq.com>		2026-04-26 03:38:47 -04:00
..
fixtures	lexer: pass code-unit length to U16_NEXT in UTF-16 decoders	2026-04-26 03:38:47 -04:00