vllm-project
vLLM is an open-source, high-throughput inference and serving engine for large language models. It is maintained by a global community and supports scalable deployment for production workloads, integrating with modern AI infrastructure.
- Total products in the ecosystem
- 2