thennal/IMaSC
Viewer • Updated • 31.3k • 209 • 10
How to use smcproject/Malwhisper-v1-small with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("automatic-speech-recognition", model="smcproject/Malwhisper-v1-small") # Load model directly
from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq
processor = AutoProcessor.from_pretrained("smcproject/Malwhisper-v1-small")
model = AutoModelForSpeechSeq2Seq.from_pretrained("smcproject/Malwhisper-v1-small")This model is a fine-tuned version of openai/whisper-small fine-tuned on IMASc dataset.
IMaSC is a Malayalam text and speech corpus made available by ICFOSS for the purpose of developing speech technology for Malayalam, particularly text-to-speech. The corpus contains 34,473 text-audio pairs of Malayalam sentences spoken by 8 speakers, totalling in approximately 50 hours of audio.
GPUs used: T4 - 16 GB
Training Time: 14 hours
The fine-tuned model on evaluating in the following dataset:
In SMC Malayalam Speech Corpus dataset:
WER - 73.56
CER - 17.82