GitHub / France-Travail / happy_vllm
A REST API for vLLM, production ready
JSON API: https://ecosystem.code.gouv.fr/api/v1/hosts/GitHub/repositories/France-Travail%2Fhappy_vllm
Stars: 24
Forks: 3
Open issues: 5
License: agpl-3.0
Language: Python
Size: 857 KB
Dependencies parsed at: Pending
Created at: over 1 year ago
Updated at: 3 months ago
Pushed at: 11 days ago
Last synced at: about 20 hours ago
Topics: api-rest, llm, llm-serving, production, vllm
Readme
Loading...