lit-llama
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
- ATK
- 6063
- DEF
- 4190
Uncommon
Lightning-AI/lit-llama
Uncommon · Base · GenesisImplementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Attack6,063
Defense4,190
Drag the card to turn it. Use the flip button to see the back.
Open card page