AutoGPT 是面向自主智能体的开源平台,支持用自然语言或可视化流程创建、运行和管理能够持续执行任务的智能体。
关于 SGLang
SGLang – Fast, Open-Source LLM & Multimodal Serving Framework Join us for the first SGLang Summit on Nov 12 - 13, 2026 in SF. Register now Doc Blog Model Event Ecosystem Summit 2026 GitHub High-Performance Serving Framework for LLMs and Multimodal Models SGLang powers fast, scalable inference for large language and multimodal models. Get Started Join us in San Francisco Open foundations for the next era of AI. November 12–13, 2026 Fort Mason, San Francisco Join the Summit Production-Grade Inference Built for large-scale deployments, delivering reliable, low-latency, high-throughput serving from a single accelerator to distributed clusters. Model & Hardware Flexibility Supports large language, vision-language, and diffusion models for text, multimodal understanding, and image and video generation across diverse hardware platforms. Advanced Optimizations Incorporates disaggregated prefill/decode, speculative decoding, parallelisms, a zero-overhead scheduler, and optimized GPU kernels. Get Started in Seconds Select your preferences and run the deployment command. SGLang is designed to be easy to install and deploy. 1 Install via pip or docker The easiest ways to get started. 2 Launch the server Start the server with a single command pointing to your model. 3 Query the API Use standard OpenAI-compatible endpoints to interact with your model. View Documentation Build Stable Nightly Platform CUDA ROCm TPU XPU CPU Package Python (uv) Python Docker CUDA Version CUDA 12.9 CUDA 13.0 Run this Command: uv pip install sglang sglang-kernel \ --extra-index-url https://sgl-project.github.io/whl/cu129/ \ --extra-index-url https://download.pytorch.org/whl/cu129 \ --index-strategy unsafe-best-match Trusted in Production Hear from the teams serving their models with SGLang. Agentic AI demands faster, more efficient inference and training, enabled by deep co-design across software and hardware. Through our longstanding collaboration with the SGLang team, SGLang and Miles deliver optimized performance across NVIDIA GPU generations, including the latest Vera Rubin. Ujval Kapasi Vice President of AI & HPC Frameworks and Libraries, NVIDIA Cloudflare’s strength is doing more with less, and in an era where GPU compute is scarce and expensive, SGLang helps us push to get every FLOP out of our GPUs. The team has been a wonderful partner to the open-source community, and we couldn’t ask for better partners in the world of inference. Michelle Chen Group PM – AI Platform, Cloudflare At P
访问提示
本站仅提供官网信息与访问导航,不代表对该网站的产品、服务或交易作出担保。访问外部网站时,请核对网址,注意账号和财产安全。
同类型网站
查看分类百川智能发布的金融大模型,金融场景能力领先GPT-4o近20%
Build a Large Language Model (From Scratch) 是一款AI 大模型方向的 AI 工具,适合主流大语言模型与开源模型。
支持多 AI Agent 框架的可视化管理面板,支持 OpenClaw 和 Hermes Agent 双引擎,内置智能助手一键安装诊断