JetBrains Research unites scientists working in challenging new disciplines

Learning to Run with Reward Shaping. Domain Adaptation for Gesture Recognition from sEMG.

At this seminar, Aleksandra Malysheva will present our papers at the upcoming ICARCV conference.

Paper 1. Learning to Run with Reward Shaping from Video Data.

We present experiments in which we combine selected techniques from the top ten approaches from the NIPS competition with further optimizations to create an high-performing agent as a baseline. We then demonstrate how video-based reward shaping improves the performance further, resulting in an RL agent that runs twice as fast as the baseline in 12 hours of training. We furthermore show that our approach can overcome sub-optimal running behaviour in videos, with the learned policy significantly outperforming that of the running agent from the video.

Paper 2. Continuous Gesture Recognition from sEMG Sensor Data with Recurrent Neural Networks and Adversarial Domain Adaptation.

In this paper, for the first time, we present empirical results on gesture recognition with both mobile and non-mobile wrists. Furthermore, we demonstrate that recurrent neural networks with simple recurrent units (SRU) outperform regular RNNs in both cases in terms of gesture recognition accuracy, on data acquired by an arm band sensing electromagnetic signals from arm muscles (via surface electromyography or sEMG). Finally, we show that adding domain adaptation techniques to continuous gesture recognition with RNN improves the transfer ability between subjects, where a limb controller trained on data from one person is used for another person.

Speaker: Aleksandra Malysheva.

Presentation language: English.

Date and time: November 6th, 20:30-22:00.

Location: Times, white boards (4th floor).