litert_dart 0.2.0
litert_dart: ^0.2.0 copied to clipboard
On-device LiteRT-LM (.litertlm) LLM inference for pure Dart via dart:ffi. No Flutter. Load a model (Gemma, Qwen, DeepSeek…) and generate text locally.
Use this package as an executable
Install it
You can install the package from the command line:
dart pub global activate litert_dartUse it
The package has the following executables:
$ fetch_natives
Use this package as a library
Depend on it
Run this command:
With Dart:
$ dart pub add litert_dartWith Flutter:
$ flutter pub add litert_dartThis will add a line like this to your package's pubspec.yaml (and run an implicit dart pub get):
dependencies:
litert_dart: ^0.2.0Alternatively, your editor might support dart pub get or flutter pub get. Check the docs for your editor to learn more.
Import it
Now in your Dart code, you can use:
import 'package:litert_dart/litert_dart.dart';