Document Preview Unavailable

Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance

Goldman, Omer; Caciularu, Avi; Matan Eyal; Cao, Kris; Szpektor, Idan; et al.  arXiv.org, Jun 22, 2024.

You might have access to this document