MethodChannelMaathaiLlamma class

An implementation of MaathaiLlammaPlatform that uses method channels.

Inheritance

Properties

eventsChannel → EventChannel
final
hashCode → int
The hash code for this object.
no setterinherited
methodChannel → MethodChannel
The method channel used to interact with the native platform.
final
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited

Methods

cancel() → Future<void>
override
generate({required String prompt, int maxTokens = 512, String? cancelToken}) → Future<String>
override
generateStream({required String prompt, int maxTokens = 512, String? cancelToken}) → Stream<String>
override
initialize() → Future<bool>
override
loadModel({required String modelPath, int contextLength = 4096, int threads = 0, int? threadsBatch, int? batchSize, int gpuLayers = 0, bool preferPerformanceCores = true, int? maxModelBytes, double temperature = 0.7, int topK = 40, double topP = 0.95, double? minP, double? typicalP, double? topNSigma, int? mirostatType, double? mirostatTau, double? mirostatEta, double? repeatPenalty, double? frequencyPenalty, double? presencePenalty, int? repeatLastN, int? minKeep}) → Future<bool>
override
noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
release() → Future<void>
override
toString() → String
A string representation of this object.
inherited
updateSampler({required double temperature, required int topK, required double topP, double? minP, double? typicalP, double? topNSigma, int? mirostatType, double? mirostatTau, double? mirostatEta, double? repeatPenalty, double? frequencyPenalty, double? presencePenalty, int? repeatLastN, int? minKeep}) → Future<void>
override

Operators

operator ==(Object other) → bool
The equality operator.
inherited