gguf 0.1.0 copy "gguf: ^0.1.0" to clipboard
gguf: ^0.1.0 copied to clipboard

GGUF file parser (to support getting information from LLM models to be run with llama.cpp)

example/example.dart

import 'package:gguf/gguf.dart';

void main() async {
  final gguf = await parseGgufFile('model.gguf');
  print('Version: ${gguf.version}');
  print('Tensors: ${gguf.tensors.length}');
  print('Metadata keys: ${gguf.metadata.keys}');
}
0
likes
150
points
30
downloads

Publisher

unverified uploader

Weekly Downloads

GGUF file parser (to support getting information from LLM models to be run with llama.cpp)

Repository (GitHub)
View/report issues

Topics

#gguf #llamacpp #llama-cpp #llm

Documentation

API reference

License

BSD-3-Clause (license)

Dependencies

json_annotation

More

Packages that depend on gguf