Skip to content

Add return_offset_mapping support to PreTrainedTokenizer#1702

Open
anidoesdev wants to merge 4 commits into
huggingface:mainfrom
anidoesdev:main
Open

Add return_offset_mapping support to PreTrainedTokenizer#1702
anidoesdev wants to merge 4 commits into
huggingface:mainfrom
anidoesdev:main

Commits

Commits on Jun 7, 2026

Commits on Jun 8, 2026