Submissions

Sandya Mannarswamy

@sandyasm

  • Joined Sep 2019

Anthill Inside 2019

Tutorial on Testing of Machine Learning Applications

##URL for workshop date, time, venue, schedule and tickets: https://hasgeek.com/anthillinside/testing-machine-learning-applications-workshop/ more
  • 0 comments
  • Confirmed
  • 03 Sep 2019
Section: Tutorials Technical level: Intermediate Session type: Tutorial

Anthill Inside 2019

Rigorous Evaluation of NLP Models for Real World Deployment

Rapid progress in NLP Research has seen a swift translation to real world commercial deployment. While a number of success stories of NLP applications have emerged, failures of translating scientific progress in NLP to real-world software have also been considerable (some of these issues are covered in my IJCAI paper https://www.ijcai.org/proceedings/2018/717). Specifically, the challenges and ga… more
  • 1 comment
  • Confirmed & scheduled
  • 03 Sep 2019
Section: Full talk Technical level: Intermediate Session type: Discussion

The Fifth Elephant 2020 edition

Is Your NLP Model Solving the Dataset Or the Actual Task? - Identifying, Analyzing and Mitigating Spurious Dataset Cues in NLP Applications

Natural Language Processing models are susceptible to learning spurious and shallow patterns in the dataset which does not generalize well to real world data. Given that dataset serves as the proxy for the actual task on hand, often deep learning NLP models learn from the spurious shallow patterns in the dataset instead of solving the actual task on hand. The presence of such non-robust brittle f… more
  • 0 comments
  • Submitted
  • 24 Mar 2020

Submissions for MLOps November edition

Opening the NLP Blackbox - Analysis, Evaluation and Testing of NLP Models

Rapid progress in NLP Research has seen a swift translation to real world commercial deployment. While a number of success stories of NLP applications have emerged, failures of translating scientific progress in NLP to real-world software have also been considerable. Evaluation of NLP models is often limited to held out test set accuracy on a handful of datasets, and analysis of NLP models is oft… more
  • 1 comment
  • Submitted
  • 13 Jun 2021