
Download and run AI models on your own computer.
Provider-checked pricing
Loading this page…
AI TOOL DETAILS
Serve language models through an inference engine designed for throughput and efficient resource use.


The listed option is free to use. Hosting or model usage may still cost money.
The Apache-2.0 serving software is free. Models, GPU hardware, electricity, storage and cloud compute have separate terms and costs. Installing the runtime does not include a hosted inference allowance.
Provider pricing checked 13 Oct 2026.
Read the repository for the license, installation steps, and operating costs.
Open source repositoryView the full software profileRead a practical guide before choosing a plan or setting up a workflow.
How to use an AI coding tool and check its workThis preference stays on your device. It does not change public rankings.