LocalAI

Model Deployment

mudler/LocalAI

49.8K4.5KGoMIT

LocalAI is an open-source local AI runtime engine that can run large models, speech, image, video and other AI models on any hardware without requiring a GPU.

🧠 Model Deployment🗣️ Text-to-Speech🎨 Image Generation🏠 Local Runtime

LocalAI preview — Preview card generated by GitHub from the repository. Star counts on the card may lag behind the figures above.

Tool Info

Type🐙 Open Source

Stars49.8K

Forks4.5K

LanguageGo

LicenseMIT

Unlock the full analysis — free

You're reading the public preview of LocalAI. The AI-written pros & cons, use cases, setup guide and audience fit are free with an account — no credit card. Pro adds AI comparisons (50 per 30 days) and member daily & weekly reports.

Compare LocalAI with alternatives

See how it stacks up against other model deployment tools.

More Tools

tensorflow

201.2K

An open-source machine learning framework that lets developers build and train their own AI models.

ollama

184.2K

A tool that lets you easily run various large language models on your local computer, supporting popular models like DeepSeek, Qwen, and Gemma.

transformers

168.0K

Load and run various pre-trained AI models in Python, covering tasks such as text, image, and audio.

llama.cpp

131.9K

Run large language models offline on your own computer, no internet or expensive GPU required

vllm

93.4K

An open-source inference engine that serves large language models as fast APIs with higher throughput and lower memory use.