flutter_ort_genai 0.1.0 
flutter_ort_genai: ^0.1.0 copied to clipboard
ONNX Runtime GenAI for Flutter - High-performance LLM inference with streaming token generation
0.1.0 #
- Initial release of ONNX Runtime GenAI for Flutter
- Support for LLM inference with streaming token generation
- Cross-platform implementation (Android, iOS, macOS)
- Built on ONNX Runtime GenAI C API
- Model validation and error handling
- Support for generation parameters (temperature, top-p, top-k, max tokens)
Metadata
0
likes
140
points
104
downloads
Publisher
unverified uploader
Weekly Downloads
Metadata
ONNX Runtime GenAI for Flutter - High-performance LLM inference with streaming token generation
Repository (GitHub)
View/report issues
Topics
#ai #llm #onnx #genai #inference
Documentation
License
MIT (license)
Dependencies
More
Packages that depend on flutter_ort_genai
Packages that implement flutter_ort_genai
