exllama
A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
- ATK
- 2657
- DEF
- 2132
A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
Drag the card to turn it. Use the flip button to see the back.
Open card page