# Gguf Inference

Source: <gh-file:examples/gguf_inference.py>.

```{literalinclude} ../../../../examples/gguf_inference.py
:language: python
:linenos:
```