Tag · inference

Inference apps on winget

8 inference apps indexed from microsoft/winget-pkgs. Each one ships with a ready-to-paste winget install command and a silent variant for unattended deployment.

F
Foundry Local CLIMicrosoft Corporation
Microsoft.FoundryLocalv0.12.1.0
Foundry Local enables local execution of Small Language Models using the hardware on your device.
BitLlama Desktopimonoonoko
imonoonoko.BitLlamaDesktopv1.0.0
Desktop GUI for BitLlama LLM inference engine with Soul learning and model management
BitLlamaimonoonoko
imonoonoko.BitLlamav1.0.0
Pure Rust LLM inference engine with 1.58-bit ternary support and Test-Time Training
D
dmrDocker Inc.
Docker.dmrv0.1.0
Standalone Docker Model Runner - run local AI models with no Docker Desktop or Engine required.
R
RagIQ RuntimeEngineRagIQ
RagIQ.RuntimeEnginev1.0.0
Lightweight, highly optimized CPU runtime for GGUF models and embeddings.
R
ResolveIQ RuntimeResolveIQ
ResolveIQ.Runtimev1.0.0
Branded CPU-optimized GGUF inference and embedding runtime.
Z
zyguardMakPr016
MakPr016.zyguardv0.1.0-beta.1
A from-scratch, GPU-accelerated local inference engine and TUI chat client for the LFM2.5 model family.
Open Model ManagerOMM Hippo
OmmHippo.OMMv0.2.149
Manage local AI models across supported inference engines.