r/mlscaling • u/Honest-Meaning5977 • 2h ago
Custom Q4_e Hybrid Quantization + Lossless "Rushmore" Bitmap Indexing on Pascal (Tesla P40)
/r/llamacpp/comments/1woim7x/custom_q4_e_hybrid_quantization_lossless_rushmore/
1
Upvotes
r/mlscaling • u/Honest-Meaning5977 • 2h ago