资讯
Meet Switchyard: A Rust Proxy and Library That Routes and Translates LLM Traffic Across OpenAI and Anthropic APIs
📌 概要
NVIDIA开源Switchyard，一款基于Rust的代理与库，用于跨OpenAI和Anthropic API路由与转换LLM流量。它将请求解码为供应商中立类型，支持直通、随机、LLM分类器等路由算法，并把响应转换回客户端格式，使Claude Code或Codex CLI可无改动对接vLLM、NIM或Ollama。项目处于pre-alpha阶段，尚不可用于生产。
⚡ 关键要点
- ▸NVIDIA发布Apache-2.0开源的Rust代理与库Switchyard
- ▸支持passthrough、随机、LLM分类器、stage-router等多种路由算法
- ▸可在OpenAI与Anthropic API间转换，让客户端无改动对接vLLM、NIM、Ollama
- ▸项目仍为pre-alpha，明确不适用于生产环境
NVIDIA has released Switchyard, an Apache-2.0 Rust proxy and library for LLM traffic. It decodes requests into provider-neutral types, routes them with passthrough, random, LLM-classifier, or stage-router algorithms, and translates responses back into the client's format, so Claude Code or Codex CLI can run against vLLM, NIM, or Ollama unchanged. The project is pre-alpha and not for production.
The post Meet Switchyard: A Rust Proxy and Library That Routes and Translates LLM Traffic Across OpenAI and Anthropic APIs appeared first on MarkTechPost.