llm_toolkit 0.0.4 copy "llm_toolkit: ^0.0.4" to clipboard
llm_toolkit: ^0.0.4 copied to clipboard

A comprehensive Flutter SDK for running Large Language Models (LLMs) locally on mobile and desktop devices. Supports multiple inference engines including Gemma (TFLite) and Llama (GGUF) with integrate [...]

example/lib/main.dart

import 'package:flutter/material.dart';
import 'screens/model_browser_screen.dart';
import 'theme/app_theme.dart';

void main() {
  runApp(LLMToolkitApp());
}

class LLMToolkitApp extends StatelessWidget {
  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      title: 'LLM Toolkit Pro',
      theme: AppTheme.lightTheme,
      darkTheme: AppTheme.darkTheme,
      themeMode: ThemeMode.system,
      home: ModelBrowserScreen(),
      debugShowCheckedModeBanner: false,
    );
  }
}
5
likes
110
points
117
downloads

Publisher

unverified uploader

Weekly Downloads

A comprehensive Flutter SDK for running Large Language Models (LLMs) locally on mobile and desktop devices. Supports multiple inference engines including Gemma (TFLite) and Llama (GGUF) with integrated model discovery, download, and chat capabilities.

Repository (GitHub)
View/report issues

Documentation

API reference

License

MIT (license)

Dependencies

collection, crypto, dio, fftea, flutter, flutter_gemma, http, json_annotation, llama_cpp_dart, objectbox, objectbox_flutter_libs, path, path_provider, record, tflite_flutter

More

Packages that depend on llm_toolkit