exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
- ATK
- 4984
- DEF
- 3178
Common
turboderp-org/exllamav2
Common · Base · GenesisA fast inference library for running LLMs locally on modern consumer-class GPUs
Attack4,984
Defense3,178
Drag the card to turn it. Use the flip button to see the back.
Open card page