Skip to content

tokenizer: account for multi-byte characters in tokenize_with_range#39

Merged
jmhain merged 1 commit into
mainfrom
joey/utf8
Sep 22, 2025
Merged

tokenizer: account for multi-byte characters in tokenize_with_range#39
jmhain merged 1 commit into
mainfrom
joey/utf8

fix token with range to account for multi-byte characters

3c231b4
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

The logs for this run have expired and are no longer available.