Server chat + RAG

Persisted server session with attach_knowledge: document IDs are merged into rag_options on each ask(). Requires SDK ≥ 0.1.9.

python

from tokensaver_sdk import HISTORY_SERVER, TokenSaver

ts = TokenSaver(api_key="ts_...")

doc = ts.rag_ensure_document("./specs/api_overview.pdf")

doc_id = str(doc["document_id"])

session = ts.chat.session(history=HISTORY_SERVER, name="Support bot")

session.attach_knowledge(doc_id)

answer = session.ask(

    "What authentication scheme does the API use?",

    provider="openai",

    model="gpt-4o",

    use_rag=True,

    rag_similarity_threshold=0.55,

    rag_options={"top_k": 8},  # document_ids come from attach_knowledge

print(answer.text)

session.clear_knowledge()

Explicit rag_options["document_ids"] on a single ask merges with attached IDs (attached first, deduplicated).