Gateway · request-time control

Request-time control in your network: each AI request decided under the signed policy and recorded.

The gateway runs in your network, between your applications and the model providers. It decides each request under the signed policy revision from the Control Plane and records the decision. A request served without a record is counted in a gap record.

Request path

ONE REQUEST, TOP TO BOTTOM01 Keyx-api-key or Bearer40102 Accessapplication lifecycle40303 Stopsemergency stops, every mode40304 Detecttype and position05 Decidesigned policy40306 Rewriteredaction tokens07 Forwardyour provider key08 Recordsigned by the instance09 Deliverto the ledger or your S3Red: refused, in your SDK's error format, and recorded(an unknown key is only counted, not recorded)
Nine steps for every request · red: steps where a request can be refused

Capabilities

Three modes

Start in record-only mode. Nothing changes for your applications, and you see what the policy would have done.

Record onlyrecord_only

Every request is forwarded unchanged to its model's default endpoint, and everything the policy would have done is recorded. Requests under an emergency stop, and requests with an unknown model or key, are refused in every mode.

  • Forwarded unchanged, except for stops
  • Personal data redaction applies
  • Rules route or refuse
  • Emergency stops refuse
  • Each decision recorded
Advisoryadvisory

The rules only record what they would have done. Redaction of personal data still applies before forwarding.

  • Forwarded unchanged, except for stops
  • Personal data redaction applies
  • Rules route or refuse
  • Emergency stops refuse
  • Each decision recorded
Enforceblocking

The rules are applied. A request is redacted, routed or refused as the policy states, and recorded.

  • Forwarded unchanged, except for stops
  • Personal data redaction applies
  • Rules route or refuse
  • Emergency stops refuse
  • Each decision recorded
Three modes, set in the signed policy revision · labels as the console shows them
Steps
  1. 1On Gateways, click Add a gateway and issue its credential.
  2. 2Install the gateway in your network, in record-only.
  3. 3Point one application's SDK at the gateway, with that application's application key.
  4. 4Send one request and open its record in the Ledger.

Gateway topics