Use IoT sensors + TensorFlow + RxJS + your hands to control the Angular app
Submitted by Bartosz Pietrucha (@pietrucha) on Thursday, 19 April 2018
In this talk I will show you how to utilize machine learning algorithms and RxJS stream processing to recognize gestures made by hand movements. You hold your smartphone in your hands and make a meaningful gesture. Smartphone generates accelerometer signal that is fetched by web application. RxJS process this stream of data points and executes machine learning algorithm on TensorFlow.js to recognize your intention! This is later used to control an application or even a game! You will learn how to apply all the pieces together and build immersive user experience. Come and join me in this journey full of fun and science!
Introduction to machine learning
Getting the acceleromenter data
RxJS realtime stream processing
Recognizing hand movement gesture
Applying intention to the application