Skip to main content
The Rayify SDKs are for non-AI applications - server backends, batch jobs, automation, custom UIs. If you’re building an LLM-driven workflow, use the MCP server instead.

Python

Install

For the local inference bridge:

Quickstart

Environment-based config

Local inference bridge

Opens a WebSocket tunnel to the Rayify cloud. Agents tagged runtime: local route their inference requests through this tunnel to your local LLM endpoint.

TypeScript

Install

Quickstart

Vercel AI SDK integration

Configuration

Error handling

Both SDKs preserve the underlying cause when wrapping errors:

What’s next