llm_toolkit 0.0.4 copy "llm_toolkit: ^0.0.4" to clipboard
llm_toolkit: ^0.0.4 copied to clipboard

A comprehensive Flutter SDK for running Large Language Models (LLMs) locally on mobile and desktop devices. Supports multiple inference engines including Gemma (TFLite) and Llama (GGUF) with integrate [...]

Use this package as a library

Depend on it

Run this command:

With Flutter:

 $ flutter pub add llm_toolkit

This will add a line like this to your package's pubspec.yaml (and run an implicit flutter pub get):

dependencies:
  llm_toolkit: ^0.0.4

Alternatively, your editor might support flutter pub get. Check the docs for your editor to learn more.

Import it

Now in your Dart code, you can use:

import 'package:llm_toolkit/llm_toolkit.dart';
5
likes
110
points
117
downloads

Publisher

unverified uploader

Weekly Downloads

A comprehensive Flutter SDK for running Large Language Models (LLMs) locally on mobile and desktop devices. Supports multiple inference engines including Gemma (TFLite) and Llama (GGUF) with integrated model discovery, download, and chat capabilities.

Repository (GitHub)
View/report issues

Documentation

API reference

License

MIT (license)

Dependencies

collection, crypto, dio, fftea, flutter, flutter_gemma, http, json_annotation, llama_cpp_dart, objectbox, objectbox_flutter_libs, path, path_provider, record, tflite_flutter

More

Packages that depend on llm_toolkit