Document Preview Unavailable
Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance
Goldman, Omer; Caciularu, Avi; Matan Eyal; Cao, Kris; Szpektor, Idan; et al. arXiv.org, Jun 22, 2024.You might have access to this document
- 
Try and log in through your institution to see if they have access to the full text.
 Log in through your library




