llama_model_params class final

Inheritance
Implemented types
Available extensions

Constructors

llama_model_params()

Properties

address → Pointer<T>

Available on T, provided by the StructAddress extension

The memory address of the underlying data.
no setter
check_tensors ↔ bool
getter/setter pair
devices ↔ Pointer<ggml_backend_dev_t>
getter/setter pair
hashCode → int
The hash code for this object.
no setterinherited
kv_overrides ↔ Pointer<llama_model_kv_override>
getter/setter pair
main_gpu ↔ int
getter/setter pair
n_gpu_layers ↔ int
getter/setter pair
no_alloc ↔ bool
getter/setter pair
no_host ↔ bool
getter/setter pair
progress_callback ↔ llama_progress_callback
getter/setter pair
progress_callback_user_data ↔ Pointer<Void>
getter/setter pair
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited
split_mode → llama_split_mode
no setter
split_modeAsInt ↔ int
getter/setter pair
tensor_buft_overrides ↔ Pointer<llama_model_tensor_buft_override>
getter/setter pair
tensor_split ↔ Pointer<Float>
getter/setter pair
use_extra_bufts ↔ bool
getter/setter pair
use_mlock ↔ bool
getter/setter pair
use_mmap ↔ bool
getter/setter pair
vocab_only ↔ bool
getter/setter pair

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toString() → String
A string representation of this object.
inherited

Operators

operator ==(Object other) → bool
The equality operator.
inherited