The Fifth Elephant Open Source AI Hackathon 2024
The Fifth Elephant For members

The Fifth Elephant Open Source AI Hackathon 2024

GenAI makers and creators contest and showcase

Make a submission

Accepting submissions till 15 Feb 2024, 11:00 PM

Hasura, Bangalore

Tickets

Loading…

Overview

The Fifth Elephant Open Source AI Hackathon started on 5 January 2024 and reached its finale with a Demo Day event on 12 April 2024, when the winners of the two month long contest were chosen.

The aim of this hackathon was to encourage individuals/teams to apply and incubate innovative AI ideas/use cases and publish them as open source projects. The hackathon contest participants worked with mentors for over two months to refine their ideas, and advance them to a stage where they are viable projects that could be pursued beyond the hackathon.

The contestants worked on AI’s application in education, accessibility, creative expression, scientific research, languages, under the overall theme of AI for India.

As a campaign to raise awareness and drive up developer adoption of AI and open source technologies, the hackathon has been a great success. It has helped shine light on the agility that open source technology enables for creative and innovative developers.

Demo day finale

Testimonials

“...each one of the contestants put in tremendous effort. And we saw the passion in every person, trying to do things not for winning, but about really building your projects. After a long time, I am attending such a hackathon where young folks are so passionate about building. Kudos to all of you”.
- Rukma Talwadker, Jury Member, Senior Principal Scientist at Games 24x7

“I really enjoyed judging all the projects - lot of interesting work. The Fifth Elephant has done a great job with mentoring and curating this hackathon”.
- Tanuja Ganu, Jury Member, Principal RSDE Manager, Microsoft India

“The hallmark of this hackathon was getting younger people to code for a longer period of time as opposed to a typical hackathon which turns out to be about — how do you build the coolest thing in the shortest period of time”.
- Sumod Mohan, mentor.

“What is impressive about this particular hackathon is, it is not just about cool ideas and fancy demos. It is actually about building a product or a software or a model that can live beyond the demo (and contest).”
- Soma Dhavala, team member at Project Seshu

“It was only through putting my ideas to code that I learnt what the specificity of implementing these (LLMs) were clarified. I began my journey with a sense of hope and commitment towards FOSS principles, and the Hackathon only reinforced my belief that collaboration maketh a better product.”
- Sankalp Srivastava, Creator of Project Schematise

Key highlights from the hackathon

During the course of 12 weeks, the hackathon involved:

  1. Started off on 5 January 2024 and invited open source ideas and projects.
  2. Mentorship sessions in February for all project teams. Mentors included Abhishek H Mishra aka Tokenbender, Arvind Saraf, Bharat Shetty, Ramesh Hariharan, Sidharth Ramachandran, Simrat Hanspal, Sumod Mohan and Vinayak Hegde.
  3. The 10 best from 40 applications were chosen for the Demo Showcase.
  4. An involved peer-review process helped further refine projects between March 1st - 15th, followed by extensive rehearsals from April 8th - 10th, 2024.
  5. On Demo Showcase Day - we had project demos from 10 qualifying teams; 5 project winners were chosen on 12 April 2024.

The Prizes

🏆 Five prizes of ₹1,00,000 (One lakh rupees) per theme, were awarded to winning projects.
The prizes for this hackathon have been sponsored by Meta.

Note: Apart from the contest prizes, Microsoft has offered internships to the contestants.

Jury

  1. Ashok Hariharan heads data and business intelligence at United Nations Volunteers.
  2. Rukma Talwadker is Senior principal scientist at Games24x7.
  3. Shubha Shedthikere is a Senior Manager in the Data Science team at Swiggy.
  4. Sunil Abraham is the Public Policy Director for Data Economy and Emerging Tech at Meta, India.
  5. Tanuja Ganu is a Principal RSDE Manager at Microsoft Research India.

Mentors

  1. Abhishek Mishra is a is creator of CodeCherryPop LLM series.
  2. Arvind Saraf is a computer scientist, engineering leader, entrepreneur trained at IIT, MIT and Google.
  3. Simrat Hanspal is currently spearheading AI product strategy at Hasura.
  4. Sumod Mohan is the co-founder and CEO of AutoInfer.

Editors

About The Fifth Elephant

The Fifth Elephant is a community of practitioners, who share feedback on data, AI and ML practices in the industry. If you like the work that The Fifth Elephant does and want to support its activities - review of Papers, Books, building the innovation ecosystem in India through hackathons and conferences - contribute by picking up a membership.

Contact

💬 Post a comment with your questions here, or join The Fifth Elephant Telegram group and the WhatsApp group.

Follow @fifthel on Twitter.

📞 For any inquiries, call The Fifth Elephant at +91-7676332020.

sponsor image

Hosted by

The Fifth Elephant - known as one of the best data science and Machine Learning conference in Asia - has transitioned into a year-round forum for conversations about data and ML engineering; data science in production; data security and privacy practices. more

Supported by

Venue host

Welcome to the events page for events hosted at The Terrace @ Hasura. more

Partner

Microsoft for Startups Founders Hub is a digital ecosystem removing barriers to building a company with free access to technology, coaching, and support for founders in any stage of development. Let us accelerate your startup journey from idea-to-exit. Find out more here: https://startups.microsoft… more

Mayank Kumar

@munk

DeepMask

Submitted Feb 15, 2024

Problem Statement

Deepfake technology has increasingly become a tool for creating highly realistic and yet completely fabricated images and videos, posing significant privacy risks. This technology allows for the impersonation of individuals in various contexts, potentially leading to identity fraud, privacy breaches, and reputational damage for both individuals and organizations. The ease with which deepfakes can be created and disseminated, especially given the availability of open-source deepfake generation tools, exacerbates these risks. Moreover, deepfakes have found applications in malicious activities ranging from social engineering attacks to the creation of nonconsensual pornographic content, heightening concerns about privacy and security in the digital realm.

The alarming capability of deepfake technology to produce believable content from minimal real-life input (one image or mere seconds of audio) further underscores the urgency of addressing this issue. As such technologies continue to evolve at a rapid pace, outstripping efforts to regulate their use or implement effective countermeasures on social media platforms, there is a critical need for proactive solutions that empower individuals to protect their digital identities.

Here a single image from a (fake) Social profile is used to create a deepfake video from a popular gif

Hey Bali, do you want a promotion?


Bali got deepfaked by a malicious actor, and he missed an important opportunity! The harms could have been much deeper

When it comes to deepfakes, prevention is (a lot) better than cure

Proposed Solution: Deepmask

Deepmask is an innovative approach that leverages AI technology not as a tool for invasion of privacy but as a means of defense against potential abuses of digital identity through deepfakes. By enabling users to anonymize their personal information and create virtual personas or avatars with unique faces, styles, and voices, Deepmask provides a layer of protection designed to prevent individuals’ likenesses from being exploited in deepfake creations.

Professional Profile Social Profile
Bali’s Private images
OpenPose Virtual Face generator template Prompt: a good young indian office employee, black hair, male Prompt: a funky young indian party animal, black hair, male
Deepmasked images, with non users “anonymized”

Technology Stack:

  • Face Generation: Utilizing Stable Diffusion with ControlNet enabled, and set to ControlType: OpenPose_faceonly for generating virtual faces.
  • Face Swap: Implementing ReActor plugin for swapping faces between images or videos.
  • Body Swap: Employing Segment Anything (SAM) model for body selection and using Stable Diffusion to anonymize or swap bodies within content.
  • Voice Swap: WhisperX for text detection, TortoiseTTS for Speech generation

Milestones:

  1. P0 - Face Masking: The initial phase focuses on creating virtual avatars by generating unique faces that users can adopt in their online presence.
  2. P1 - Voice Masking: This phase introduces the capability to alter voice recordings such that they match the generated virtual avatars while protecting the user’s original voice characteristics.
  3. P2 - Auto Users Face Matching and Customized Swapping: Enhancing user experience by automatically matching users’ faces with suitable virtual avatars based on preferred features and facilitating customized face swapping.
  4. P3 - Body Masking: The final phase extends the anonymization process to include body masking, allowing users to select and swap entire body images, further enhancing privacy and protection against deepfake exploitation.

Use Cases

Deepmask serves a wide array of users and scenarios, offering vital solutions in several contexts:

  • Personal Privacy Protection: Individuals concerned about their digital footprint and privacy can use Deepmask to present a virtual persona online, reducing the risk of their real images being used in deepfakes.
  • Social Media Integrity: Content creators who wish to maintain an online presence without compromising their real-life identity can utilize Deepmask for creating content that remains true to their creative vision but disconnects from their personal identity.
  • Professional and Corporate Security: Businesses can protect their employees’ identities in digital communications, safeguarding against impersonation attacks that could lead to data breaches or financial fraud.

Challenges & Future Directions

While Deepmask presents a promising solution against the misuse of deepfake technology, several challenges remain. These include ensuring the accessibility of the technology for non-technical users, maintaining the balance between anonymity and authenticity, and continuously adapting to evolving deepfake technologies.

Future developments could explore integrating more advanced AI techniques for even more realistic voice and face generation, improving user interfaces for easier customization of avatars, and expanding partnerships with social media platforms for broader implementation of anonymization features. Additionally, ethical considerations around the use of such technologies must be addressed continuously to ensure they are used responsibly.

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Make a submission

Accepting submissions till 15 Feb 2024, 11:00 PM

Hasura, Bangalore

Hosted by

The Fifth Elephant - known as one of the best data science and Machine Learning conference in Asia - has transitioned into a year-round forum for conversations about data and ML engineering; data science in production; data security and privacy practices. more

Supported by

Venue host

Welcome to the events page for events hosted at The Terrace @ Hasura. more

Partner

Microsoft for Startups Founders Hub is a digital ecosystem removing barriers to building a company with free access to technology, coaching, and support for founders in any stage of development. Let us accelerate your startup journey from idea-to-exit. Find out more here: https://startups.microsoft… more