llamafu 0.0.1 copy "llamafu: ^0.0.1" to clipboard
llamafu: ^0.0.1 copied to clipboard

A Flutter package for running language models on device with support for completion, instruct mode, tool calling, streaming, constrained generation, LoRA, and multi-modal inputs (images, audio).

0.0.1 #

  • Initial release
  • Basic text completion functionality
  • Android and iOS support
  • FFI bindings for Dart
  • Multi-modal support (images, audio)
  • LoRA adapter support
  • Constrained generation with GBNF grammars
  • Streaming output support
  • Comprehensive API documentation
  • Example application demonstrating all features
  • Unit tests for core functionality
0
likes
130
points
24
downloads

Publisher

unverified uploader

Weekly Downloads

A Flutter package for running language models on device with support for completion, instruct mode, tool calling, streaming, constrained generation, LoRA, and multi-modal inputs (images, audio).

Repository (GitHub)
View/report issues

Topics

#ai #llm #llama #on-device #machine-learning

Documentation

Documentation
API reference

License

MIT (license)

Dependencies

ffi, flutter

More

Packages that depend on llamafu

Packages that implement llamafu