Preview video

Hack Five
Hack Five

Open Source AI Hackathon 2024

GenAI makers and creators contest and showcase

Tickets

Loading…

All submissions
This submission has been added to the schedule


Preview video

Session video
Submission video

Kurian Benoy

Aldrin Jenson

@aldrinjenson

Nabeel Boda

@bodanabeel

Indic subtitler

Submitted Jan 30, 2024

Category: AI for image generation/creatives

Project Objective

The number of tools which are available in Indian languages to subitle audio and videos in Indian languages are almost none. Yet that shouldn’t be the case, as now there are lot of open-source models supporting speech transcription in most of official Indian languages. This tool can be useful for subtitling audios and videos like Indian cinemas for Media Industry in general.

Project Feasability

Due to advent of new technologies like Meta’s seamless M4T model and Whisper fine-tuned models, you can do speech transcription to transcribe audio’s from source audio to source text. With this a Hindi audio can be transcribed to Hindi text for generating subtitles. Meta’s seamless M4T model also supports translation which can take Hindi audio and generate subtitle in languages like English, French, Malayalam etc.

I have tried this feature in my github repository for audio in Malayalam. Given the timeline, I am prioritizing building a minimum viable product (MVP) that focuses on core functionalities: uploading videos/audios, transcribing speech to text in selected Indian languages, and displaying subtitles. Additional features can be added based on the time available.

Project details

Github repo: https://github.com/kurianbenoy/Indic-Subtitler
Demo Video: https://www.loom.com/share/f434e100766548f1b24a073fe4fe6e8c
Hosted Website: https://indicsubtitler.in/

All submissions

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hybrid access (members only)

Hosted by

Hack Five
Hack Five
The Fifth Elephant hackathons

Supported by

Host

The Fifth Elephant
The Fifth Elephant
Jump starting better data engineering and AI futures
Meta
Meta

Venue host

H
Hasura
Welcome to the events page for events hosted at The Terrace @ Hasura. more

Partner

Microsoft for Startup's
Microsoft for Startup's
Providing all founders, at any stage, with free resources to build a successful startup.