LLM Engine
A software that can load the LLM Models
Open WebUI
A Web UI Tool for Ollama URLs https://openwebui.com/ GitHub: https://github.com/open-webui/...
Kuwa Gen AI OS
一個自由、開放、安全且注重隱私的生成式人工智慧服務系統，包括友善的大語言模型使用介面，以及能支援生成式人工智慧應用的新型GenAI核心。 🌐 提供多語言GenAI開發與部署的整體解決方案，...
AnythingLLM
The ultimate AI business intelligence tool. Any LLM, any document, full control, full privacy. A...
Ollama
Run Llama 3, Phi 3, Mistral, Gemma, and other models. Customize and create your own. https://o...
LM Studio
Discover, download, and run local LLMs. With LM Studio, you can ... 🤖 - Run LLMs on your laptop...
Text generation web UI
A Gradio web UI for Large Language Models. 只能執行本地模型，不支援外部模型 API。 支援以下多重功能的 AI 平台 Chat Fine-...
OpenLLM
OpenLLM helps developers run any open-source LLMs, such as Llama 2 and Mistral, as OpenAI-compati...
NVIDIA NIM
Explore the latest community-built AI models with an API optimized and accelerated by NVIDIA, the...
Xinference
Xorbits Inference (Xinference) is an open-source platform to streamline the operation and integra...
Bechmark
bench.py ollama 支持并发之后和 vllm 相比性能如何？我们测测看_ollama vllm-CSDN博客 YT: ollama vs vllm - 开启并发之后的 oll...
OpenAI Proxy
Proxy Server to call 100+ LLMs in a unified interface & track spend, set budgets per virtual key/...