SGLang 与 Miles 为前沿多模态模型 Inkling 提供 Day-0 支持,推理吞吐达 71.7k tok/s
Blog SGLang and Miles Add Day-0 Support for Inkling, a Frontier Multimodal Model We're excited to partner with the Thinking Machines team to bring Day-0 support for Inkling to SGLang and Miles, with dedicated optimizations for its new architecture and broad feature coverage, and w... SGLang Team & Thinking Machines Lab
AI 导读SGLang 与 Miles 为 Thinking Machines Lab 的 975B 参数多模态模型 Inkling 提供 Day-0 支持,其上下文窗口达 1M token。
来源:LMSYS Blog · lmsys.org