Source <gh-file:examples/offline_inference/gguf_inference.py>.

# GGUF Inference

:::{literalinclude} ../../../../examples/offline_inference/gguf_inference.py
:language: py
:::