# Lightning-AI/lit-llama — RepoVerse

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

URL: https://repoverse.app/cards/617504730

[Repository source](https://github.com/Lightning-AI/lit-llama)

## Card snapshot

- Edition: Genesis
- Rarity: uncommon
- Finish: Base
- Attack: 6063
- Defense: 4190
- GitHub stars: 6081
- GitHub forks: 517
- Language: Python
- Category: Python Ecosystem
- Snapshot date: 2026-10-22

These repository statistics and game attributes belong to this dated card snapshot. They are not a current assessment of software quality.

This page describes the repository card, without a holder or individual copy record.

- [Rules](https://repoverse.app/rules.md)
- [Explore](https://repoverse.app/explore)
