vLLM
High-throughput engine for serving language models on GPUs.
Free download (open source)
- Developer
- vLLM Project
- License
- Apache-2.0
- Platforms
- Linux
- Category
- Development & technology
Useful for
- AI for large organisations and enterprises
- AI for developers
- AI for researchers
- AI for cloud, servers and hosting
Similar apps
Checked by AppHami.ai on the official source