mockingbird_ios 0.1.0 copy "mockingbird_ios: ^0.1.0" to clipboard
mockingbird_ios: ^0.1.0 copied to clipboard

PlatformiOS

The iOS implementation of the mockingbird plugin: the Mockingbird engine built from source with Core Audio capture and ONNX Runtime detectors.

mockingbird_ios #

The iOS implementation of the mockingbird plugin. It is endorsed, so depending on mockingbird includes it automatically.

What it bundles #

  • The Mockingbird engine compiled from source into the host app: capture, RNNoise, libfvad, the anomaly gate, the Opus encoder, and the ONNX Runtime detectors (Silero VAD and YAMNet).
  • Microphone capture through a Core Audio RemoteIO unit, which supplies the OS host-time stamp of every buffer. The plugin configures and activates the recording AVAudioSession itself.

The Dart side reaches the C ABI through DynamicLibrary.process(). There are no platform channels.

Integration #

Both CocoaPods and Swift Package Manager are supported.

Integration Minimum iOS
CocoaPods 15.0
Swift Package Manager 15.0

ONNX Runtime comes from the onnxruntime-c pod or from Microsoft's onnxruntime-swift-package-manager package, depending on the integration.

Requirements #

Add a usage description to Info.plist, or the system denies the microphone without a prompt:

<key>NSMicrophoneUsageDescription</key>
<string>Used to detect voice and sounds.</string>

If you request the permission with permission_handler, add PERMISSION_MICROPHONE=1 to the post_install block of your Podfile. Engines created with MockingbirdBackend.hostPcm do not touch the microphone.

0
likes
160
points
346
downloads

Documentation

API reference

Publisher

unverified uploader

Weekly Downloads

The iOS implementation of the mockingbird plugin: the Mockingbird engine built from source with Core Audio capture and ONNX Runtime detectors.

Repository (GitHub)
View/report issues

Topics

#audio #vad #ios #ffi

License

MIT (license)

Dependencies

flutter, mockingbird_platform_interface

More

Packages that depend on mockingbird_ios

Packages that implement mockingbird_ios