CactusContext class
Properties
- hashCode → int
-
The hash code for this object.
no setterinherited
- initParams ↔ CactusInitParams
-
latefinal
- runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
Methods
-
applyLoraAdapters(
List< LoraAdapterInfo> adapters) → Future<void> -
bench(
{int pp = 512, int tg = 128, int pl = 1, int nr = 1}) → Future< BenchResult> -
completion(
CactusCompletionParams params, {List< String> mediaPaths = const []}) → Future<CactusCompletionResult> -
detokenize(
List< int> tokens) → Future<String> -
embedding(
String text) → Future< List< double> > -
formatChatWithTools(
List< ChatMessage> messages, String toolsJson, {String? chatTemplate}) → Future<({String? grammar, String prompt})> -
getLoadedLoraAdapters(
) → Future< List< LoraAdapterInfo> > -
initMultimodal(
String mmprojPath, {bool useGpu = true}) → Future< void> -
isMultimodalEnabled(
) → Future< bool> -
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
release(
) → void -
releaseMultimodal(
) → Future< void> -
removeLoraAdapters(
) → Future< void> -
rewind(
) → Future< void> -
stopCompletion(
) → Future< void> -
supportsAudio(
) → Future< bool> -
supportsVision(
) → Future< bool> -
tokenize(
String text) → Future< List< int> > -
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited
Static Methods
-
init(
CactusInitParams params) → Future< CactusContext>