Llama.cpp
On 15 Oct 2026 NVIDIA released a new Windows app for the open‑source llama.cpp runtime, adding support for decision‑model inference and enabling llama.cpp integration in agent apps such as GitHub Copilot, Hermes, OpenClaw, Perplexity, Pi and WorkBuddy. The update supports hybrid routing between local and cloud LLMs via Switchyard, and is part of the RTX Spark laptop launch on 16 Oct 2026. Nemotron 3.5 Bolt 74B-A9B 24GB supports llama.cpp Unsloth shipped a llama.cpp implementation llama.cpp implementation has dynamic GGUFs AnyLanguageModel 1.0 uses llama.cpp for open‑weight models granite-speech-5.0-2b is supported in llama.cpp Flint supported by llama.cpp runtime Unsloth shipped a llama.cpp implementation with dynamic GGUFs· Entity summary generated by Graphiti
Relation timeline
BY VALID-FROM DATE- AnyDecisionModelUSES MODEL ONLlama.cpp
AnyDecisionModel ... using a model on your device with llama.cpp.
- FlintSUPPORTED BYLlama.cpp
Flint supported by llama.cpp runtime
- granite-speech-5.0-2bIS SUPPORTED INLlama.cpp
granite-speech-5.0-2b is supported in llama.cpp
- UnslothSHIPPEDLlama.cpp
Unsloth shipped a llama.cpp implementation
- Llama.cppHAS FEATUREdynamic GGUFs
llama.cpp implementation has dynamic GGUFs
- AnyLanguageModel 1.0USESLlama.cpp
AnyLanguageModel 1.0 uses llama.cpp for open‑weight models
- Nemotron 3.5 Bolt 74B-A9B 24GBSUPPORTSLlama.cpp
Nemotron 3.5 Bolt 74B-A9B 24GB supports llama.cpp
- UnslothSHIPPED IMPLEMENTATION OFLlama.cpp
Unsloth shipped a llama.cpp implementation with dynamic GGUFs
Relations are facts Graphiti extracted from reports, not verbatim quotes. An end date means later reporting showed the relation no longer holds.
Events 5
- Introducing AnySpeechRecognizer and AnyDecisionModel: Open Models for Speech and Decisions on Apple Platforms2 cited reports · 2026-10-29
- Recursive shows first result of its AI-driven research process with Flint1 cited report · 2026-10-22
- Granite Speech 5.0: Transcribe, Translate, and Attribute more Accurately and Faster1 cited report · 2026-10-21
- [AINews] not much happened today1 cited report · 2026-10-20
- Nvidia's Nemotron 3.5 Super VL is an open model built to run enterprise AI agents nonstop1 cited report · 2026-10-16
Source reports 6
- Introducing AnySpeechRecognizer and AnyDecisionModel: Open Models for Speech and Decisions on Apple PlatformsHugging Face Blog · first-party · 2026-10-29
- Recursive shows first result of its AI-driven research process with FlintThe Decoder · 2026-10-22
- Granite Speech 5.0: Transcribe, Translate, and Attribute more Accurately and FasterHugging Face Blog · first-party · 2026-10-21
- [AINews] not much happened todayLatent Space · 2026-10-20
- AnyLanguageModel 1.0: One Year of Local Models on Apple PlatformsHugging Face Blog · first-party · 2026-10-20
- Nvidia's Nemotron 3.5 Super VL is an open model built to run enterprise AI agents nonstopThe Decoder · 2026-10-16