forMemoryEfficiency method

OllamaBuilder forMemoryEfficiency()

Configure for memory efficiency

Optimizes settings to minimize memory usage, suitable for resource-constrained environments.

Implementation

OllamaBuilder forMemoryEfficiency() {
  return numGpu(0) // CPU only
      .numCtx(1024) // Smaller context window
      .numBatch(128) // Smaller batch size
      .keepAlive("5m"); // Shorter keep-alive
}