User Guide

Welcome to the Speculators User Guide. This guide will help you get started with training and deploying speculative decoding models.

Overview

Speculators provides a comprehensive framework for:

• Training speculative decoding models
• Converting existing models to the Speculators format
• Deploying models with vLLM

Quick Links

• Getting Started - Start here if you're new to Speculators
• Features - Detailed documentation on core features
• Algorithms - Overview of supported algorithms
• Tutorials - Step-by-step guides