CascadeAgent for speculative model cascading with quality validation.
Install
CascadeAgent
ModelConfig
CascadeAgentOptions
Result
Features
- Speculative execution with quality validation
- Multi-provider support (OpenAI, Anthropic, Groq, Ollama, vLLM)
- Streaming responses
- Tool calling and structured output
- Cost tracking and analytics
- Works in Node.js, Browser, and Edge Functions