TokenSaver
FR

Docs / Core concepts

Policies & modules

Turn cache, RAG, compression, and PII on/off per TokenSaver API key from Governance in the console — or via API/SDK.

Policies are scoped to a key so you can give a “safe” key to LibreChat (PII on) and a “fast eval” key to CI (cache on, RAG off). The Modules panel in the console reflects effective modules for the selected key.

Policy scope
  1. Workspace
  2. API key (ts_…)
  3. Enabled modules
  4. Runtime pipeline
  1. Open Governance Select the TokenSaver key in the header selector so you edit the right scope.
  2. Toggle modules Enable Cache / RAG / Compression / PII. Save. Confirm Modules panel badges update.
  3. Send traffic Any Connect or Build path using that key inherits the policy immediately.
Governance — policies for one key

Developers: Native API · Python SDK.