好网站,从官网开始
企业认领/联系与合作
官网导航 提交官网
S

SGLang官网

SGLang 是高性能 LLM 推理框架,支持多模态模型,已在 40 万+ GPU 上部署,吞吐量领先 vLLM。

官网资料

网站名称
SGLang
身份核实
尚未完成企业认领核实
最近更新
链接检测
尚未检测

关于 SGLang

SGLang – Fast, Open-Source LLM & Multimodal Serving Framework Join us for the first SGLang Summit on Nov 12 - 13, 2026 in SF. Register now Doc Blog Model Event Ecosystem Summit 2026 GitHub High-Performance Serving Framework for LLMs and Multimodal Models SGLang powers fast, scalable inference for large language and multimodal models. Get Started Join us in San Francisco Open foundations for the next era of AI. November 12–13, 2026 Fort Mason, San Francisco Join the Summit Production-Grade Inference Built for large-scale deployments, delivering reliable, low-latency, high-throughput serving from a single accelerator to distributed clusters. Model & Hardware Flexibility Supports large language, vision-language, and diffusion models for text, multimodal understanding, and image and video generation across diverse hardware platforms. Advanced Optimizations Incorporates disaggregated prefill/decode, speculative decoding, parallelisms, a zero-overhead scheduler, and optimized GPU kernels. Get Started in Seconds Select your preferences and run the deployment command. SGLang is designed to be easy to install and deploy. 1 Install via pip or docker The easiest ways to get started. 2 Launch the server Start the server with a single command pointing to your model. 3 Query the API Use standard OpenAI-compatible endpoints to interact with your model. View Documentation Build Stable Nightly Platform CUDA ROCm TPU XPU CPU Package Python (uv) Python Docker CUDA Version CUDA 12.9 CUDA 13.0 Run this Command: uv pip install sglang sglang-kernel \ --extra-index-url https://sgl-project.github.io/whl/cu129/ \ --extra-index-url https://download.pytorch.org/whl/cu129 \ --index-strategy unsafe-best-match Trusted in Production Hear from the teams serving their models with SGLang. Agentic AI demands faster, more efficient inference and training, enabled by deep co-design across software and hardware. Through our longstanding collaboration with the SGLang team, SGLang and Miles deliver optimized performance across NVIDIA GPU generations, including the latest Vera Rubin. Ujval Kapasi Vice President of AI & HPC Frameworks and Libraries, NVIDIA Cloudflare’s strength is doing more with less, and in an era where GPU compute is scarce and expensive, SGLang helps us push to get every FLOP out of our GPUs. The team has been a wonderful partner to the open-source community, and we couldn’t ask for better partners in the world of inference. Michelle Chen Group PM – AI Platform, Cloudflare At P

访问提示

本站仅提供官网信息与访问导航,不代表对该网站的产品、服务或交易作出担保。访问外部网站时,请核对网址,注意账号和财产安全。

同类型网站 366

查看分类

AutoGPT 是面向自主智能体的开源平台,支持用自然语言或可视化流程创建、运行和管理能够持续执行任务的智能体。

支持多 AI Agent 框架的可视化管理面板,支持 OpenClaw 和 Hermes Agent 双引擎,内置智能助手一键安装诊断

让更多人找到你的官网

提交网站信息,建立清晰、完整的官网资料。

免费提交官网

咨询提交、推广、认领

客服微信二维码,长按识别或保存后使用微信扫一扫

扫一扫添加微信,沟通官网导航提交、认领、推广需求。

可长按识别,或保存图片后在微信扫一扫中识别。

添加时可备注“官网导航”,便于沟通您的企业需求。

保存二维码 打开原图