Gguf Inference
==============

Source https://github.com/vllm-project/vllm/blob/main/examples/gguf_inference.py.

.. literalinclude:: ../../../../examples/gguf_inference.py
    :language: python
    :linenos: