Anthill Inside 2019

A conference on AI and Deep Learning



Suraj Sheth


Reinforcement Learning

Submitted Apr 29, 2019

We see quite a lot of excitement around Reinforcement Learning (RL) in industry and academia. We regularly see new industrial applications both inside and outside of Amazon. We also see RL papers dominating many ML conferences such as NeurIPS and ICML. RL is promising for multiple reasons that include a better formulation of the problem which allows for optimization of multi-step decision making process and its ability to learn strategies for unseen, dynamic scenarios. RL has gained traction in recent years with the use of deep neural networks to accomplish astonishing results in applications such as games, robotics, recommendations and operations research problems. We propose this workshop to bring people together to share ideas, increase awareness and build a community around RL.


The workshop is designed to give an overview of RL and dive deep into some of the state-of-the-art techniques in RL.
Reinforcement Learning:

  1. Introduction
  2. Definitions and Problem Statement
  3. Classical Approaches
  4. Evolutionary Algorithms
  5. Temporal Differences
  6. Q-Learning
  7. Exploration and Exploitation
  8. Evaluating Reinforcement Learning Algorithms
  9. On-Policy Learning
  10. Assigning Credit and Blame to Paths
  11. Model-Based Methods
  12. Reinforcement Learning with Features
  13. Deep Reinforcement Learning
  14. Atari Games, Self-Driving and other applications


Laptop with Python installed/Cloud host

Speaker bio

Suraj is a Senior Machine Learning Scientist working on a variety of Machine Learning problems at Amazon. Prior to this, he has worked at IBM Research(IRL) and Adobe. His areas of work include Natural Language Processing, Deep Recurrent Networks, CNNs for text, Reinforcement Learning, and Generative Models. Suraj has more than 8 years of industry experience in the field of Machine Learning, NLP, Deep Learning and Reinforcement Learning. He has presented papers/posters in AMLC for last three years, delivered talks/tutorials at GHCI, AITC and others. He has three USPTO approved patents. He has conducted Reinforcement Learning workshops at several occasions including Amazon SMML Workshop 2018. He is organizing “Reinforcement Learning” workshop at Amazon Machine Learning Conference 2019.


{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hybrid access (members only)

Hosted by

Anthill Inside is a forum for conversations about risk mitigation and governance in Artificial Intelligence and Deep Learning. AI developers, researchers, startup founders, ethicists, and AI enthusiasts are encouraged to: more