Alpa (अल्प) — Sanskrit speech in 18 MB
An English voice model, converted to Sanskrit: two tables edited by hand, then 100 minutes on a CPU. No GPU.
Early preview, v0.1. One trained voice, 3.5 hours of speech, checked by one listener and one recogniser. See Limits.
Listen
| Text | Audio |
|---|---|
| धर्मक्षेत्रे कुरुक्षेत्रे समवेता युयुत्सवः। मामकाः पाण्डवाश्चैव किमकुर्वत सञ्जय॥ | |
| नटः पटं धरति, बालः पत्रं पठति। कटिः कति? दण्डः दन्तः च। | |
| घटे जलं नास्ति। कोटिः जनाः नाटकं पश्यन्ति। गुडः मधुरः, पीडा कठिना। | |
| यथा धर्मः तथा अर्थः। बुद्धिमान् भीमः सुखेन कथां कथयति। | |
| विद्या ददाति विनयं, विनयाद् याति पात्रताम्। |
Each sample was generated once; nothing was re-rolled or selected. Verse is read aloud as text; Alpa does not chant.
From English to Sanskrit, without a GPU
tiny-voca is a 4.5-million-parameter model that speaks English. Its author trained it from scratch in 7.7 hours on an RTX 4090. Alpa is that same network, converted to Sanskrit in two moves.
1. Rewrite two small tables by hand. Of the model's 4.5 million numbers, 9,600 (0.2%) say which sound is which and how heavy a syllable is. We replaced those, by lookup, with no training:
- each Sanskrit sound starts from the nearest English sound (आ from the vowel of "father", क from "k");
- ट ड ण ष, which English lacks, start as 70% of their nearest English sound plus 30% of English "r", because a retroflex and an English "r" are both made with the tongue curled back;
- laghu and guru take the place of unstressed and stressed.
The other 99.8% of the network was copied untouched. At that point, with no training at all, it already read Sanskrit with an English accent.
2. Give it 100 minutes on a four-core CPU, with 3.5 hours of Sanskrit speech to listen to. Preparing those recordings took about another hour on the same CPU.
| Stage | Training | Phonemes misread by a Sanskrit recogniser |
|---|---|---|
| English model with the two tables rewritten | none | 26.6% |
| The same, after 100 minutes on a CPU | 3,000 steps | 3.1% |
| The human recordings it learned from | 3.3% |
Starting from the English weights is what makes this cheap. In an early side-by-side on the same 20 minutes of audio and the same 400 steps, a model starting from random weights misread 46.8% and the edited English model 18.3% (measured then with a different, English-leaning recogniser).
The edit that training could not replace
English has no ट, ड or ण, and training alone did not find them. We ran the same 3,000 steps twice, once with those four sounds starting as plain copies of their English neighbours and once with the "30% r" start. That is a difference of 768 numbers.
| ट ड ण between two vowels, heard correctly | ट | ड | ण |
|---|---|---|---|
| Plain start, 3,000 steps | 24% | 52% | 83% |
| Hand-edited start, 3,000 steps (this model) | 86% | 81% | 97% |
| Human recordings | 100% | 90% | 100% |
What the recogniser wrote for नटः पटं धरति … कोटिः जनाः नाटकं पश्यन्ति:
- plain start: नतः पतं धरति … कोतिः जनाः नातकं पश्यन्ति
- hand-edited start: नटः पटं धरति … कोटिः जनाः नाटकं पश्यन्ति
Small
| Model | What it does | Parameters | Download | Size against Alpa |
|---|---|---|---|---|
| Alpa v0.1 | Sanskrit speech | 4.5 M | 18 MB | 1× |
| Vāgdhenu, browser port | Sanskrit chant | quantised | 296 MB | 16× |
| Vāgdhenu | Sanskrit chant | 337 M + 112 M vocoder | 1.8 GB | 99× |
| Indic Parler-TTS | Speech in many Indian languages, Sanskrit among them | 938 M | 3.75 GB | 206× |
Sizes are the files on each model's Hugging Face page on 16 November 2026. The larger models are larger for good reasons: Vāgdhenu chants in metre, and Indic Parler-TTS covers many languages and voices. Alpa does one thing, in a size that fits in a web page.
Runs in a browser tab
The whole path, from typed Devanagari to audio, runs inside the page: the text reader under Pyodide, the model under ONNX Runtime Web on one thread. Nothing is sent to a server.
| Measured in Chromium, one thread | Speed | A 7.8-second verse takes |
|---|---|---|
| As is | 12.4× real time | 0.7 s |
| CPU slowed 4× | 2.9× real time | 2.7 s |
| CPU slowed 6× | 1.9× real time | 4.3 s |
The model file for the browser is 21 MB; with both runtimes a page needs 46 MB in total.
The only other in-browser Sanskrit voice we know of is the port of Vāgdhenu, a chant system. By its own published benchmark it downloads 296 MB and, on a Pixel 10 Pro XL with six threads, needs about 15.5 seconds to chant a 7.5-second verse, with the first quarter-verse arriving after about 3.8 seconds.
These two are not the same test. Theirs is a real flagship phone; ours is a desktop browser on a 2.1 GHz cloud CPU, slowed with Chrome's own CPU throttle to imitate slower hardware. Alpa has not yet been timed on a real phone.
The file is onnx/alpa-v0.1-preview.onnx; onnx/alpa-v0.1-preview.json lists its inputs and the phoneme table.
<script src="https://cdn.jsdelivr.net/npm/onnxruntime-web@1.20.1/dist/ort.wasm.min.js"></script>
<script type="module">
// ids and weight come from alpa/text.py, which runs unchanged under Pyodide
ort.env.wasm.wasmPaths = "https://cdn.jsdelivr.net/npm/onnxruntime-web@1.20.1/dist/";
const int64 = (v) => new ort.Tensor("int64", BigInt64Array.from(v.map(BigInt)), [1, v.length]);
const one = (x) => new ort.Tensor("float32", Float32Array.from([x]), [1]);
ort.env.wasm.numThreads = 1;
const session = await ort.InferenceSession.create("alpa-v0.1-preview.onnx", { executionProviders: ["wasm"] });
const out = await session.run({ tokens: int64(ids), weight: int64(weight),
voice: new ort.Tensor("int64", BigInt64Array.from([1n]), [1]), // 1 = male
speed: one(1), pitch_shift: one(0), pitch_range: one(1) });
// out.audio.data is a Float32Array at 24 kHz
</script>
Scores
The judge is Su-śrotā, a Sanskrit speech recogniser. It listened to 148 sentences held out of training, spoken once by Alpa from text alone and once by the original voice artist.
Alpa, male |
Human recordings | |
|---|---|---|
| Phonemes misread | 3.1% | 3.3% |
| ट heard as ट | 93% | 97% |
| ड heard as ड | 89% | 94% |
| ण heard as ण | 98% | 99% |
| त, द, न heard correctly | 98–100% | 98–100% |
Read these with two cautions. The recogniser knows Sanskrit words and partly guesses from context, which flatters both columns; the stricter between-vowels figures are in the table further up. And a recogniser is not an ear: one human listener has checked a handful of lines.
Against other systems. There is no shared benchmark for Sanskrit speech synthesis yet, and the other systems have not been run through this judge, so we make no quality claim against them. Vāgdhenu's authors report a mean opinion score of about 4.6 from an expert listener, for chant. Alpa has no listener-panel score. On desktop speed the published figures are: Alpa about 100 times faster than real time on four CPU threads; Vāgdhenu about 3.5 times faster than real time on an M5 Max.
Use it
pip install "torch>=2.4" numpy soundfile huggingface_hub
hf download 77ethers/alpa --local-dir alpa-model
cd alpa-model
python -m alpa.infer --checkpoint alpa-v0.1-preview.pt --voice male \
--text "सत्यमेव जयते नानृतम्।" --output out.wav
From Python, inside the same folder:
import soundfile as sf
from alpa.infer import load_model, speak
model = load_model("alpa-v0.1-preview.pt")
audio, phonemes, _ = speak(model, "सत्यमेव जयते नानृतम्।", "male")
sf.write("out.wav", audio.numpy(), 24000)
speak also takes speed, pitch_shift and pitch_range. Text in Kannada, Telugu, Bengali or Malayalam script is read as well if you pip install indic-transliteration. The model file holds plain tensors and settings only and is loaded with weights_only=True.
| Parameters | 4,531,723 |
| Files | alpa-v0.1-preview.pt (18 MB), onnx/alpa-v0.1-preview.onnx (21 MB) |
| Audio | 24 kHz, mono |
| Input | Sanskrit in Devanagari |
| Voices | male is trained. female is present but was never trained on Sanskrit |
| Licence | Apache-2.0 |
What the text reader does
- Every written vowel is spoken, including the final
a: राम is rāma. - An aspirated stop is spoken as the stop followed by ह.
- Anusvāra takes the class of the stop that follows it inside a word.
- Comma, daṇḍa, double daṇḍa, question mark and exclamation mark become pauses.
- Each syllable is marked laghu or guru, and the model is told which.
- The text is read as written. Sandhi is neither applied nor undone.
Limits
- One trained voice. With
female, ट and ड are noticeably weaker. - Little data and a short run. It learned from 3.5 hours, and the adversarial stage of tiny-voca's recipe, which adds much of the naturalness, has not been run. The voice can sound flatter or buzzier than larger systems.
- ण and न are not yet fully distinct to a human listener.
- Word-final visarga is sometimes weak. The recogniser missed it in three of the five samples above.
- It speaks; it does not chant. Vedic accent marks are ignored.
- Untested: single words on their own, very long compounds, long passages, real phones. One call takes up to 512 symbols; split longer text at sentence marks.
- Digits and Latin letters are not spoken.
Credits and licence
Alpa is released under the Apache License 2.0. It stands on other people's work:
- tiny-voca by Muhammed Nazeem (Apache-2.0): the model design, the training recipe, the browser export and the starting weights. Alpa's weights are derived from tiny-voca's. See
THIRD_PARTY_NOTICES.md. - Rasa by AI4Bharat (CC-BY-4.0): the recordings it learned from.
- Vāgdhenu and Su-śrotā by Prathosh A P, Indian Institute of Science: the pronunciation and scansion rules follow Vāgdhenu's, and Su-śrotā was used to measure the result. Neither is included here.
- wav2vec2 phoneme recogniser (
facebook/wav2vec2-lv-60-espeak-cv-ft): used to time the sounds in the training recordings.
This is an independent project. None of the people or groups above has reviewed or endorsed it.
@inproceedings{ai4bharat2024rasa,
author={Praveen Srinivasa Varadhan and Ashwin Sankar and Giri Raju and Mitesh M. Khapra},
title={{Rasa: Building Expressive Speech Synthesis Systems for Indian Languages in Low-resource Settings}},
year=2024,
booktitle={Proc. INTERSPEECH 2024},
}
Model tree for 77ethers/alpa
Base model
n4ze3m/tiny-voca



