From word embeddings to contextual word embeddings and Transfer Learning for NLP

From word embeddings to contextual word embeddings and Transfer Learning for NLP

Learn how to build powerful NLP models

Anthill Inside

Anthill Inside is a community of data scientists, product managers, AI and DL engineers.
Discover how math, data models, ML and products are connected.

Juspay Technologies Private Limited, Bangalore

Tickets

Tickets

Loading...

About

Over the last couple of years, powerful deep learning methods have emerged to build industrial scale natural language understanding applications.
The first wave of deep learning models employed pre-trained word embeddings (word2vec or GloVe) to initialize the first layer of a neural network followed by a task specific model trained using labelled data. The next wave of deep learning architectures (ELMo, ULMFiT, BERT) showed how to learn contextual word embeddings from massive amounts of unlabelled text data and then transfer this information to a wide variety of downstream tasks such as sentiment analysis, question answering etc. with limited amounts of labelled data. This approach is quite relevant for industrial settings where obtaining large amounts of labelled data is expensive. In this hands on tutorial, we will cover the important concepts behind recent developments such as word embeddings, sequence to sequence models, attention mechanism, contextual word embeddings, transfer learning and probing embeddings.

Workshop goal:

Using PyTorch, participants will learn to build Natural Language Processing (NLP) models using the above concepts.

Who should attend the workshop:

Software engineers, data scientists interested in building natural language processing (NLP) applications should consider attending this workshop.

Workshop schedule: https://hasgeek.com/anthillinside/sequence-to-sequence-models-workshop/schedule

Workshop requirements:

  1. Participants must bring their own laptops to attend the workshop.
  2. Working knowledge of Python, Jupyter notebooks, Pandas, Matplotlib is essential to participate in this workshop. Participants are expected to know this in order to attend the workshop.
  3. Working knowledge of PyTorch is preferred. The trainers will do a short introduction at the beginning of the workshop.
  4. Instructors will use Google Colab for the hands-on sessions. Access to Google Colab and Google account (in order to save notebooks) is essential.

About the instructors:

Madhu Gopinathan is currently Vice President of Data Science at MakeMyTrip (MMT), India’s leading online travel company. At MakeMyTrip, he has led the development of natural language processing models for Myra, MMT’s task bot for customer service.
Madhu holds a PhD in computer science from Indian Institute of Science (IISc), on mathematical modelling of software systems,and an MS in computer science from the University of Florida, Gainesville, USA.

Akhil Lohia is Lead Data Scientist at MakeMyTrip. He is part of the NLP team, with focus on developing Myra, MakeMyTrip’s task bot.
Akhil obtained his BS degree in Economics from IIT Kanpur and MS degree in Data Science from Barcelona Graduate School of Economics.

Workshop details:

Date: Saturday, 7 December 2019
Time: 9:30 AM to 5:30 PM

Contact details:

For tickets and other inquiries, email sales@hasgeek.com or call 7676332020.

Venue

Juspay Technologies Private Limited

444, 2nd Floor, Stallion Business Center

18th Main Road, 6th Block

Bangalore - 560095

Karnataka, IN

Loading...