LLM 框架与本地大模型部署

在自己电脑上跑大模型的推理工具，以及搭 LLM 应用的 SDK、Prompt 资源和生成式 UI。

共收录 8 个 GitHub 开源仓库，均来自 Siming 的 star 收藏，按 star 数排序。主要语言：TypeScript（3 个）、Go（1 个）、C++（1 个）。star 最多的是 ollama/ollama（★ 183,794）。

编排框架与SDK（1）

vercel/aiTypeScript★ 27.4k
The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents

ollama/ollamaGo★ 183.8k
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
ggml-org/llama.cppC++★ 131.7k
LLM inference in C/C++
getumbrel/llama-gptTypeScript★ 10.9k
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

linexjlin/GPTs★ 32k
leaked prompts of GPTs
willwulfken/MidJourney-Styles-and-Keywords-Reference★ 12.3k
A reference containing Styles and Keywords that you can use with MidJourney AI. There are also pages showing resolution comparison, image weights, and much more!
ZeroLu/awesome-nanobanana-pro★ 10.4k
🚀 An awesome list of curated Nano Banana pro prompts and examples. Your go-to resource for mastering prompt engineering and exploring the creative potential of the Nano banana pro(Nano banana 2) AI image model.