Wisej.AI.Services.ISessionTrimmingService
Namespace: Wisej.AI.Services
Assembly: Wisej.AI (3.5.0.0)
Provides functionality to trim messages in a session to reduce the number of tokens.
public interface ISessionTrimmingService
Public Interface ISessionTrimmingService
Single: Gets or sets the percentage of messages to remove (between 0.1 and 0.9).
TrimmingStrategy: Gets or sets the strategy for handling context overflow.
Trims the messages in the session to reduce the number of tokens.
session
SmartSession
The SmartSession to be trimmed.
messages
MessageCollection
Message collection to be trimmed. If null, it uses the messages in the session .
Returns: Task.
DefaultSessionTrimmingService
Last updated 1 year ago
