Home
| Documentation | Blog | User Forum | Developer Slack |
About¶
vLLM TPU is now powered by tpu-inference, an expressive and powerful new hardware plugin unifying JAX and PyTorch under a single lowering path within the vLLM project. The new backend now provides a framework for developers to:
- Push the limits of TPU hardware performance in open source.
- Provide more flexibility to JAX and PyTorch users by running PyTorch model definitions performantly on TPU without any additional code changes, while also extending native support to JAX.
- Retain vLLM standardization: keep the same user experience, telemetry, and interface.
What are you trying to do today?¶
-
I'm New
Get started quickly with core concepts, hardware setup, and step-by-step tutorials.
-
I Want to Deploy
Guides on infrastructure setup, deployment recipes, and hardware capabilities.
-
I Want to Build
Contribute code, dive into inference examples, or explore the core architecture.
Contribute¶
We're always looking for ways to partner with the community to accelerate vLLM TPU development. If you're interested in contributing to this effort, check out the Contributing guide and Issues to start. We recommend filtering Issues on the good first issue tag if it's your first time contributing.
Contact us¶
- For technical questions and feature requests, open a GitHub Issue
- For feature requests, please open one on Github here
- For discussing with fellow users, use the TPU support topic in the vLLM Forum
- For coordinating contributions and development, use the Developer Slack
- For collaborations and partnerships, contact us at [email protected]