GitHub topics: vllm
InseeFrLab/auto-tuning-vllm
Auto-tuning for vllm. Getting the best performance out of your LLM deployment (vllm+guidellm+optuna)
Language: Python - Size: 2.99 MB - Last synced at: 4 days ago - Pushed at: 14 days ago - Stars: 6 - Forks: 0
France-Travail/happy_vllm
A REST API for vLLM, production ready
Language: Python - Size: 857 KB - Last synced at: 5 days ago - Pushed at: 11 months ago - Stars: 29 - Forks: 5
France-Travail/benchmark_llm_serving
A library to benchmark LLMs via their API exposure
Language: Python - Size: 8.04 MB - Last synced at: 5 days ago - Pushed at: over 1 year ago - Stars: 8 - Forks: 1