Skip to content

Module 26: Inference Engines

Category: Ecosystem — Module 26 (3 of 5 in this category)

(Placeholder module — a short overview for now; full lesson content is coming soon.)

Software for running models yourself, from a laptop GUI to production-grade serving stacks.

Topics this module will cover: - Ollama - LM Studio - Open WebUI - llama.cpp - TensorRT - llm-d

Tutorial Progress

graph LR
    A[24: Agent Frameworks] --> B[25: Inference Providers]
    B --> C[26: Inference Engines]
    C --> D[27: UI Design]
    D --> E[28: Observability]
    style A fill:#90EE90
    style B fill:#90EE90
    style C fill:#FFFF00

Previous Module: Module 25: Inference Providers Next Module: Module 27: UI Design