CactusInitParams class
Constructors
- CactusInitParams({String? modelPath, String? modelUrl, String? modelFilename, String? mmprojPath, String? mmprojUrl, String? mmprojFilename, String? chatTemplate, int contextSize = 2048, int batchSize = 512, int ubatchSize = 512, int gpuLayers = 0, int threads = 4, bool useMmap = true, bool useMlock = false, bool generateEmbeddings = false, int poolingType = 0, int normalizeEmbeddings = 2, bool useFlashAttention = false, String? cacheTypeK, String? cacheTypeV, CactusProgressCallback? onInitProgress})
Properties
- batchSize → int
-
final
- cacheTypeK → String?
-
final
- cacheTypeV → String?
-
final
- chatTemplate → String?
-
final
- contextSize → int
-
final
- generateEmbeddings → bool
-
final
- gpuLayers → int
-
final
- hashCode → int
-
The hash code for this object.
no setterinherited
- mmprojFilename → String?
-
final
- mmprojPath → String?
-
final
- mmprojUrl → String?
-
final
- modelFilename → String?
-
final
- modelPath → String?
-
final
- modelUrl → String?
-
final
- normalizeEmbeddings → int
-
final
- onInitProgress → CactusProgressCallback?
-
final
- poolingType → int
-
final
- runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
- threads → int
-
final
- ubatchSize → int
-
final
- useFlashAttention → bool
-
final
- useMlock → bool
-
final
- useMmap → bool
-
final
Methods
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited