Document Preview Unavailable

QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs

Saleh Ashkboos; Mohtashami, Amirkeivan; Croci, Maximilian L; Li, Bo; Cameron, Pashmina; et al.  arXiv.org, Oct 29, 2024.

You might have access to this document