Models
Reference
ChangelogNative SDK examples and the ai-coustics-maintained LiveKit plugins require an
AIC_SDK_LICENSE environment variable. Browser examples take a license key directly. Get your license key from the ai-coustics Developer Platform. LiveKit Cloud authentication applies only to the LiveKit-owned plugins.LiveKit
LiveKit Quickstart
Add ai-coustics speech enhancement, VAD, and audio-quality analysis to a LiveKit Python or Node.js voice agent.
Python
Basic Usage
Download a model from the CDN, load it, configure a processor, and enhance audio in a synchronous workflow.
Async Usage
Asynchronous version of the basic example using
async/await for model downloading and audio processing.File Enhancement
Enhance WAV files from disk, downmixing multi-channel input to mono, with progress reporting.
Voice Activity Detection
Run a dedicated VAD model, tune sensitivity and hold duration, and read speech decisions from the VAD context.
Audio Analysis
Score an audio file with the Tyto analysis model across five-second windows.
Benchmark
Benchmark real-time processing throughput by spawning parallel processing sessions.
Pipecat
Speech Enhancement (AICFilter)
Voice agent that enhances incoming audio with the AICFilter.
Voice Activity Detection
Voice agent using the standalone ai-coustics VAD analyzer.
Node.js
Basic Usage
Download a model, create a processor, and enhance audio samples with the Node.js SDK.
Async Enhancement
Enhance audio with
ProcessorAsync and process concurrent streams without blocking the event loop.File Processing
Read a WAV file, enhance it with configurable model and enhancement level, and write the result to disk.
Voice Activity Detection
Run a dedicated VAD model and read speech decisions from the VAD context.
Async Voice Activity Detection
Run
VadAsync on a worker thread, including detection combined with enhancement.Audio Analysis
Buffer audio with
Analyzer and score it with Tyto using blocking or async analysis.Rust
Basic Usage
Download a model at runtime, configure a processor with enhancement parameters, and process audio.
Voice Activity Detection
Run a dedicated VAD model and read speech decisions from the VAD context.
Audio Analysis
Score an audio file with the Tyto analysis model.
Parallel Async
Process multiple streams concurrently with the async API.
Benchmark
Multi-threaded benchmark that measures real-time processing throughput across parallel sessions.
Build-Time Model Download
Download a model at build time and embed it directly into your binary using the
include_model! macro.C
Enhancement
Load a model from file, create a processor, and enhance mono audio using the C API.
Voice Activity Detection
Create an
AicVad from a dedicated VAD model and read speech decisions, with full error checking.Audio Analysis
Buffer audio through a collector and score it with the Tyto analysis model.
C++
Basic Usage
Load a model, configure a processor, and enhance mono audio using the C++ API.
Voice Activity Detection
Run a dedicated VAD model and read speech decisions from the VAD context.
Audio Analysis
Buffer audio through a collector and score it with the Tyto analysis model.
WebAssembly
Browser Quickstart
Load a model and enhance audio in the browser with the WASM SDK.