Llama.cpp
On 15 Oct 2026 NVIDIA released a new Windows app for the open‑source llama.cpp runtime, adding support for decision‑model inference and enabling llama.cpp integration in agent apps such as GitHub Copilot, Hermes, OpenClaw, Perplexity, Pi and WorkBuddy. The update supports hybrid routing between local and cloud LLMs via Switchyard, and is part of the RTX Spark laptop launch on 16 Oct 2026. Nemotron 3.5 Bolt 74B-A9B 24GB supports llama.cpp Unsloth shipped a llama.cpp implementation llama.cpp implementation has dynamic GGUFs AnyLanguageModel 1.0 uses llama.cpp for open‑weight models granite-speech-5.0-2b is supported in llama.cpp Flint supported by llama.cpp runtime Unsloth shipped a llama.cpp implementation with dynamic GGUFs· Graphiti 生成的实体摘要
关系变化
按生效时间- AnyDecisionModelUSES MODEL ONLlama.cpp
AnyDecisionModel ... using a model on your device with llama.cpp.
- FlintSUPPORTED BYLlama.cpp
Flint supported by llama.cpp runtime
- granite-speech-5.0-2bIS SUPPORTED INLlama.cpp
granite-speech-5.0-2b is supported in llama.cpp
- UnslothSHIPPEDLlama.cpp
Unsloth shipped a llama.cpp implementation
- Llama.cppHAS FEATUREdynamic GGUFs
llama.cpp implementation has dynamic GGUFs
- AnyLanguageModel 1.0USESLlama.cpp
AnyLanguageModel 1.0 uses llama.cpp for open‑weight models
- Nemotron 3.5 Bolt 74B-A9B 24GBSUPPORTSLlama.cpp
Nemotron 3.5 Bolt 74B-A9B 24GB supports llama.cpp
- UnslothSHIPPED IMPLEMENTATION OFLlama.cpp
Unsloth shipped a llama.cpp implementation with dynamic GGUFs
关系是 Graphiti 从报道中提取的事实陈述,不是原文引述;失效时间表示后来的报道显示这条关系已不成立。
相关事件 5
来源报道 6
- Hugging Face 发布 AnySpeechRecognizer 和 AnyDecisionModel Swift 包,实现 Apple 平台开源语音识别与决策模型Hugging Face Blog · 一手 · 2026-10-29
- Recursive发布Flint语言模型The Decoder · 2026-10-22
- IBM Granite Speech 5.0 系列模型发布:转录、翻译与说话人归属能力升级Hugging Face Blog · 一手 · 2026-10-21
- AINews 周报:DeepSeek V4.1 Flash 发布、MiniMax M3.1 Flash、Mercury 3、OpenCode DHS 禁令、Harness² 开源、Anthropic 公募基金等行业动态Latent Space · 2026-10-20
- Hugging Face 发布 AnyLanguageModel 1.0:Apple 平台本地模型统一 APIHugging Face Blog · 一手 · 2026-10-20
- Nvidia发布Nemotron 3.5 Super VL开放模型,配两款Bolt模型助力本地AI代理The Decoder · 2026-10-16