llm_toolkit 0.0.2 copy "llm_toolkit: ^0.0.2" to clipboard
llm_toolkit: ^0.0.2 copied to clipboard

A comprehensive Flutter SDK for running Large Language Models (LLMs) locally on mobile and desktop devices. Supports multiple inference engines including Gemma (TFLite) and Llama (GGUF) with integrate [...]

Use this package as a library

Depend on it

Run this command:

With Dart:

 $ dart pub add llm_toolkit

With Flutter:

 $ flutter pub add llm_toolkit

This will add a line like this to your package's pubspec.yaml (and run an implicit dart pub get):

dependencies:
  llm_toolkit: ^0.0.2

Alternatively, your editor might support dart pub get or flutter pub get. Check the docs for your editor to learn more.

Import it

Now in your Dart code, you can use:

import 'package:llm_toolkit/llm_toolkit.dart';
5
likes
0
points
119
downloads

Publisher

unverified uploader

Weekly Downloads

A comprehensive Flutter SDK for running Large Language Models (LLMs) locally on mobile and desktop devices. Supports multiple inference engines including Gemma (TFLite) and Llama (GGUF) with integrated model discovery, download, and chat capabilities.

Repository (GitHub)
View/report issues

License

unknown (license)

Dependencies

collection, crypto, dio, flutter, flutter_gemma, http, json_annotation, llama_cpp_dart, objectbox, objectbox_flutter_libs, path, path_provider

More

Packages that depend on llm_toolkit