Skip to content

Emit U+FFFD for malformed byte-fallback runs in BPE Decode - #1064

Open
Feldt wants to merge 1 commit into
google:devfrom
Feldt:fix/bpe-decode-invalid-utf8
Open

Emit U+FFFD for malformed byte-fallback runs in BPE Decode#1064
Feldt wants to merge 1 commit into
google:devfrom
Feldt:fix/bpe-decode-invalid-utf8

Emit U+FFFD for malformed byte-fallback runs in BPE Decode

48c8a73
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar