RL Baselines Zoo

A collection of 70+ pre-trained RL agents using Stable Baselines

S-RL Toolbox

S-RL Toolbox: Reinforcement Learning (RL) and State Representation Learning (SRL) for Robotics

Stable Baselines

A fork of OpenAI Baselines, implementations of reinforcement learning algorithms

Racing Robot

Autonomous Racing Robot With an Arduino, a Raspberry Pi and a Pi Camera

Arduino Robust Serial

A simple and robust serial communication protocol. Implementation in C Arduino, C++, Python and Rust.

Selected Publications

State representation learning aims at learning compact representations from raw observations in robotics and control applications. Approaches used for this objective are auto-encoders, learning forward models, inverse dynamics or learning using generic priors on the state characteristics. However, the diversity in applications and methods makes the field lack standard evaluation datasets, metrics and tasks. This paper provides a set of environments, data generators, robotic control tasks, metrics and tools to facilitate iterative state representation learning and evaluation in reinforcement learning settings.
In Deep RL Workshop NIPS, 2018

Recent Publications

. S-RL Toolbox: Environments, Datasets and Evaluation Metrics for State Representation Learning. In Deep RL Workshop NIPS, 2018.

Preprint Code Project Video

. PythonRobotics: a Python code collection of robotics algorithms. 2018.

Preprint Code

. Unsupervised learning of state representations for multiple tasks. In Deep RL Workshop NIPS, 2016.

PDF Video

Recent Posts

Unified structure (scikit-learn like interface) and single codestyle with documentation

Arduino built-in functions for sending/receiving data are not very handy and sturdy. We introduce a protocol to communicate (using …


October 2018 – Present


German Aerospace Center (DLR)

Machine Learning for Robots.
October 2017 – October 2018

Research Engineer

ENSTA ParisTech - U2IS robotics lab

Working on Reinforcement Learning and State Representation Learning for the DREAM project.
April 2017 – September 2017

Research Intern


Deep Learning for Human Resources.
May 2016 – August 2016

Research Intern

TU Berlin - RBO lab

Research internship in representation and reinforcement learning.