·
AI & ML interests
TECH
Recent Activity
reacted to aufklarer's post with 🔥 4 days ago We’ve published Soniqo’s voice-agent leaderboard and an article explaining what we measured.
https://huggingface.co/spaces/aufklarer/full-duplex-leaderboard
The board covers three parts of a speech system:
- Turn-taking · TurnBench: detecting turn endings, false alarms and decision delay.
- Commands · SLURP: choosing the correct tool and matching its argument values.
- Voice style · InstructTTSEval: following voice descriptions, delivery directions and role-play instructions, with separate scores for each.
Models include VAP, p99, Smart Turn, Qwen3-TTS, VoxCPM2, FireRedTTS3 and MOSS-VoiceGenerator, alongside cloud configurations from OpenAI, Google, AWS and ElevenLabs. Each table shows run sizes and links to the protocol.
We also published https://huggingface.co/aufklarer/P99-Turn-1-Mini-CoreML, https://huggingface.co/aufklarer/VAP-OTO-CoreML and https://huggingface.co/soniqo/VAP-OTO-ONNX exports. Both models have native Swift APIs; VAP also has C++ and Android support.
Explore the leaderboard https://huggingface.co/spaces/aufklarer/full-duplex-leaderboard · Read the article https://soniqo.audio/blog/voice-agent-benchmarks Organizations
None yet
