Core Concepts
Conversations
Lifecycle of conversation threads, visitor identity, message streaming, and context windows.
Overview
A Conversation represents an active exchange between a visitor and the assistant. Conversations maintain chronological history, retrieved knowledge references, and telemetry events.
Conversation Lifecycle
- Initiation: A conversation begins when a visitor opens the widget or the auto-greeting triggers.
- Session Attachment: The conversation binds to the visitor's anonymous session ID or authenticated user token.
- Message Exchange: Incoming queries generate assistant responses with streaming tokens.
- Completion / Expiry: Inactive conversations automatically archive after 24 hours of inactivity.
Real-Time Streaming
Asiyst streams assistant responses using Server-Sent Events (SSE) over HTTP/2. This guarantees near-instant Time to First Token (TTFT < 350ms) and enables word-by-word avatar speech bubble updates.
Context Sliding Window
To optimize token efficiency while maintaining coherent dialogue, Asiyst uses a 10-turn sliding context window:
- Recent messages remain fully detailed in memory.
- Older turns are summarized into a compact session summary injected into the system prompt.
Read Conversation Overview for integration details.