8 winget apps indexed. Showing results for tags:inference.
tags:inference
RagIQ.RuntimeEngine
Lightweight, highly optimized CPU runtime for GGUF models and embeddings.
nomic.gpt4all
GPT4All is a GUI application for loading and interacting with Generative AI models
Microsoft.FoundryLocal
Foundry Local enables local execution of Small Language Models using the hardware on your device.
Kanaries.Rath
Next Generation Open Source Augmented Analytics BI
imonoonoko.BitLlamaDesktop
Desktop GUI for BitLlama LLM inference engine with Soul learning and model management
Docker.dmr
Standalone Docker Model Runner - run local AI models with no Docker Desktop or Engine required.
imonoonoko.BitLlama
Pure Rust LLM inference engine with 1.58-bit ternary support and Test-Time Training
ResolveIQ.Runtime
Branded CPU-optimized GGUF inference and embedding runtime.