Guides

Hosted gateway

We run the gateway for you. Nothing to install: change your agent's base URL and use a Rakuvo key.

#How it works

Your agent talks to a Rakuvo address instead of your model provider. Rakuvo finds your organisation from your key, runs your layers, calls your model provider with your own provider key, and records the call for your dashboard.

python
from openai import OpenAI
client = OpenAI(
base_url="https://<gateway-address>/v1",
api_key="rk_...", # a gateway key from the Team page
)

#Set it up

  1. Store your provider key. In the dashboard, open Settings, find Hosted gateway, and paste your model-provider key. It is encrypted before it is stored and is never shown again, only its last four characters.
  2. Create a gateway key. On the Team page, create a key with the gateway role. That is the api_key your agent uses.
  3. Change the base URL in your agent, as above. Nothing else changes.
  4. Choose your layers on the Layers page. They apply to the next request, with no restart.

#Bring your key with each request instead

If you would rather not store your provider key with us, send it in a header. It is used for that request only and is never stored or logged:

python
client = OpenAI(
base_url="https://<gateway-address>/v1",
api_key="rk_...",
default_headers={"X-Rakuvo-Provider-Key": "sk-..."},
)

#What passes through us

Because the hosted gateway is in the path, your prompts and the model's answers pass through our servers on the way to your provider. We do not store them. What is recorded for the dashboard is metadata: tokens, latency, retries, the agent's name (from X-Rakuvo-Agent), and the note each layer wrote. If the Memory layer is on, the facts it remembers about your users are stored for your organisation.

If your prompts must never leave your network, run the gateway yourself instead: see Installation.

#Limits and safety

  • Keys. Only gateway and admin keys can send requests. A viewer key is refused. A revoked key stops working within about 20 seconds.
  • Rate limit. Each organisation has a per-second request limit. Over it, requests get HTTP 429 with a Retry-After header. Ask us to raise it.
  • Provider key. Sealed with AES-256-GCM and bound to your organisation. No API route returns it.
  • Errors. A missing provider key, a settings problem or a provider outage each return a clear message in the standard error format, so your client's error handling keeps working.

#Self-hosted or hosted?

HostedSelf-hosted
InstallNothingA program or container
Where prompts goThrough our servers to your providerStay inside your network
Provider keyStored encrypted with us, or sent per requestStays on your machine
UpdatesOursYou upgrade