| --- |
| license: other |
| license_name: per-codec |
| license_link: https://huggingface.co/BricksDisplay/codec.cpp-gguf#license |
| tags: |
| - codec.cpp |
| - gguf |
| - audio |
| - neural-audio-codec |
| --- |
| |
| # codec.cpp GGUFs |
|
|
| Neural audio codecs for [codec.cpp](https://github.com/mybigday/codec.cpp): turn |
| speech into discrete tokens and back, offline on CPU or GPU. |
|
|
| | Codec | Sample rate | Token rate | Files | |
| |---|---|---|---| |
| | [IBM DAC.speech v1.0](https://huggingface.co/ibm-research/DAC.speech.v1.0) | 24 kHz | 75 frames/s | `ibm-research--DAC.speech*.gguf` | |
| | [NVIDIA NeMo Nano Codec](https://huggingface.co/nvidia/nemo-nano-codec-22khz-0.6kbps-12.5fps) | 22.05 kHz | 12.5 frames/s (0.6 kbps) | `nemo-nano-codec-22khz-0.6kbps-12.5fps*.gguf` | |
| | [WavTokenizer large (speech)](https://huggingface.co/novateur/WavTokenizer-large-speech-75token) | 24 kHz | 75 tokens/s | `wavtokenizer-large-speech-75tokens*.gguf` | |
|
|
| Each codec comes in several precisions: the file without a suffix is F16 |
| (recommended), `-F32` is full precision, `-Q8_0` / `-Q5_K_M` / `-Q4_K_M` are |
| smaller and faster at some quality cost. |
|
|
| ## Run |
|
|
| ```bash |
| hf download BricksDisplay/codec.cpp-gguf ibm-research--DAC.speech.gguf --local-dir codecs |
| |
| ./build/codec-cli encode --model codecs/ibm-research--DAC.speech.gguf --in speech.wav --out codes.npy |
| ./build/codec-cli decode --model codecs/ibm-research--DAC.speech.gguf --codes codes.npy --out decoded.wav |
| ``` |
|
|
| Python (`pip install .` in a codec.cpp checkout; see |
| [python/README.md](https://github.com/mybigday/codec.cpp/blob/main/python/README.md)): |
|
|
| ```python |
| import codec_cpp, soundfile as sf |
| |
| ctx = codec_cpp.Model("codecs/ibm-research--DAC.speech.gguf").context() |
| pcm, sr = sf.read("speech.wav", dtype="float32") |
| codes = ctx.encode(pcm, sr) # int32 (n_frames, n_q) |
| audio, sr = ctx.decode(codes) |
| ``` |
|
|
| Build instructions and GPU flags are in the |
| [codec.cpp README](https://github.com/mybigday/codec.cpp). |
|
|
| These codecs are also the audio side of TTS models: there a llama.cpp LM |
| backbone writes the codes and codec.cpp turns them into audio (see the |
| `*-GGUF` TTS repos of this organization). |
|
|
| ## License |
|
|
| Each codec keeps its original license: DAC.speech CDLA-Permissive-2.0, NeMo Nano Codec the NVIDIA Open Model License, WavTokenizer MIT. |
|
|
