Tag · inference

Inference apps on winget

3 inference apps indexed from microsoft/winget-pkgs. Each one ships with a ready-to-paste winget install command and a silent variant for unattended deployment.

F
Foundry LocalMicrosoft Corporation
Microsoft.FoundryLocalv0.8.119.102
Foundry Local enables local execution of Small Language Models using the hardware on your device.
BitLlamaimonoonoko
imonoonoko.BitLlamav1.0.0
Pure Rust LLM inference engine with 1.58-bit ternary support and Test-Time Training
BitLlama Desktopimonoonoko
imonoonoko.BitLlamaDesktopv1.0.0
Desktop GUI for BitLlama LLM inference engine with Soul learning and model management