Open Source AI Hackathon 2024

GenAI makers and creators contest and showcase

Tickets

Loading…

Kurian Benoy

Aldrin Jenson

@aldrinjenson

Nabeel Boda

@bodanabeel

Indic subtitler

Submitted Jan 30, 2024

Project Objective

The number of tools which are available in Indian languages to subitle audio and videos in Indian languages are almost none. Yet that shouldn’t be the case, as now there are lot of open-source models supporting speech transcription in most of official Indian languages. This tool can be useful for subtitling audios and videos like Indian cinemas for Media Industry in general.

Project Feasability

Due to advent of new technologies like Meta’s seamless M4T model and Whisper fine-tuned models, you can do speech transcription to transcribe audio’s from source audio to source text. With this a Hindi audio can be transcribed to Hindi text for generating subtitles. Meta’s seamless M4T model also supports translation which can take Hindi audio and generate subtitle in languages like English, French, Malayalam etc.

I have tried this feature in my github repository for audio in Malayalam. Given the timeline, I am prioritizing building a minimum viable product (MVP) that focuses on core functionalities: uploading videos/audios, transcribing speech to text in selected Indian languages, and displaying subtitles. Additional features can be added based on the time available.

Project details

Github repo: https://github.com/kurianbenoy/Indic-Subtitler
Demo Video: https://www.loom.com/share/f434e100766548f1b24a073fe4fe6e8c
Hosted Website: https://indicsubtitler.in/

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hybrid access (members only)

Hosted by

The Fifth Elephant hackathons

Supported by

Host

Jump starting better data engineering and AI futures

Venue host

Welcome to the events page for events hosted at The Terrace @ Hasura. more

Partner

Providing all founders, at any stage, with free resources to build a successful startup.