litert_dart 0.2.0 copy "litert_dart: ^0.2.0" to clipboard
litert_dart: ^0.2.0 copied to clipboard

On-device LiteRT-LM (.litertlm) LLM inference for pure Dart via dart:ffi. No Flutter. Load a model (Gemma, Qwen, DeepSeek…) and generate text locally.

Use this package as an executable

Install it

You can install the package from the command line:

dart pub global activate litert_dart

Use it

The package has the following executables:

$ fetch_natives

Use this package as a library

Depend on it

Run this command:

With Dart:

 $ dart pub add litert_dart

With Flutter:

 $ flutter pub add litert_dart

This will add a line like this to your package's pubspec.yaml (and run an implicit dart pub get):

dependencies:
  litert_dart: ^0.2.0

Alternatively, your editor might support dart pub get or flutter pub get. Check the docs for your editor to learn more.

Import it

Now in your Dart code, you can use:

import 'package:litert_dart/litert_dart.dart';
1
likes
150
points
8
downloads

Documentation

API reference

Publisher

verified publisherjhonacode.com

Weekly Downloads

On-device LiteRT-LM (.litertlm) LLM inference for pure Dart via dart:ffi. No Flutter. Load a model (Gemma, Qwen, DeepSeek…) and generate text locally.

Repository (GitHub)
View/report issues

Topics

#llm #ffi #gemma #on-device #ai

License

unknown (license)

Dependencies

crypto, ffi, mutex

More

Packages that depend on litert_dart