Turboderp

Popular repositories Loading

1. exllamav2 exllamav2 Public

   A fast inference library for running LLMs locally on modern consumer-class GPUs

   Python 4.6k 347

2. exllamav3 exllamav3 Public

   An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

   Python 1.7k 259

3. exui exui Public

   Web UI for ExLlamaV2

   JavaScript 517 44