Whisper Small Fine-tuned for Spontaneous Persian Speech
This model is a fine-tuned version of openai/whisper-small
for Persian automatic speech recognition (ASR).
It was adapted on the Spontaneous Persian Speech (SPS) dataset, with a focus on spontaneous and conversational Persian.
Model description
- Base model:
openai/whisper-small - Language: Persian (Farsi)
- Task: Automatic Speech Recognition
- Adaptation method: Full fine-tuning
- Training duration: 2 epochs
Training data
The model was trained on speech segments extracted from the Spontaneous Persian Speech (SPS) dataset.
For this training run:
- Training segments: 16,409
- Validation segments: 1,985
The SPS dataset itself is not distributed with this model.
Training configuration
- Optimizer: AdamW
- Learning rate: 1e-5
- Weight decay: 0.01
- Warm-up ratio: 0.05
- Batch size: 1
- Gradient accumulation steps: 32
- Effective batch size: 32
- Maximum target length: 192 tokens
- Gradient checkpointing: enabled
Evaluation
The saved evaluation run contains 500 scored test segments.
Mean segment-level results:
| Model | WER | CER |
|---|---|---|
| Whisper-small baseline | 2.577 | 2.627 |
| Fine-tuned Whisper-small | 0.805 | 0.551 |
These values are mean segment-level error rates rather than corpus-level aggregated WER/CER.
The results show a substantial improvement over the corresponding Whisper-small baseline on this evaluation set.
Usage
The model can be loaded directly with Hugging Face Transformers and used to transcribe Persian audio.
from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq
model_id = "Behnooshn/whisper-small-sps-persian"
processor = AutoProcessor.from_pretrained(model_id)
model = AutoModelForSpeechSeq2Seq.from_pretrained(model_id)
Intended use
This model is intended primarily for research on Persian ASR, particularly spontaneous and conversational Persian speech.
Performance on other speech domains, recording conditions, or Persian varieties has not been systematically evaluated.
Limitations
The model was fine-tuned on a limited spontaneous Persian dataset. Its performance should therefore not be assumed to generalize equally to all speakers, domains, dialects, or acoustic conditions.
Data availability
The SPS training data are not included in this repository.
Base model
This work builds on OpenAI Whisper:
openai/whisper-small
- Downloads last month
- -
Model tree for Behnooshn/whisper-small-sps-persian
Base model
openai/whisper-small