Anthill Inside 2019 Tutorial on Testing of Machine Learning Applications##URL for workshop date, time, venue, schedule and tickets: https://hasgeek.com/anthillinside/testing-machine-learning-applications-workshop/ more
Section: Tutorials
Technical level: Intermediate
Session type: Tutorial
|
Anthill Inside 2019 Rigorous Evaluation of NLP Models for Real World DeploymentRapid progress in NLP Research has seen a swift translation to real world commercial deployment. While a number of success stories of NLP applications have emerged, failures of translating scientific progress in NLP to real-world software have also been considerable (some of these issues are covered in my IJCAI paper https://www.ijcai.org/proceedings/2018/717). Specifically, the challenges and ga… more
Section: Full talk
Technical level: Intermediate
Session type: Discussion
|
The Fifth Elephant 2020 edition Is Your NLP Model Solving the Dataset Or the Actual Task? - Identifying, Analyzing and Mitigating Spurious Dataset Cues in NLP ApplicationsNatural Language Processing models are susceptible to learning spurious and shallow patterns in the dataset which does not generalize well to real world data. Given that dataset serves as the proxy for the actual task on hand, often deep learning NLP models learn from the spurious shallow patterns in the dataset instead of solving the actual task on hand. The presence of such non-robust brittle f… more
|
Submissions for MLOps November edition Opening the NLP Blackbox - Analysis, Evaluation and Testing of NLP ModelsRapid progress in NLP Research has seen a swift translation to real world commercial deployment. While a number of success stories of NLP applications have emerged, failures of translating scientific progress in NLP to real-world software have also been considerable. Evaluation of NLP models is often limited to held out test set accuracy on a handful of datasets, and analysis of NLP models is oft… more
|