forLongConversations method
Configure for long conversations
Optimizes settings for handling long conversations with extended context retention.
Implementation
OllamaBuilder forLongConversations() {
return numCtx(8192) // Large context window
.numBatch(512) // Large batch size for efficiency
.keepAlive("2h") // Keep loaded longer
.numGpu(-1); // Use GPU for speed
}