Learning to Drive Smoothly in Minutes

Learning to drive smoothly in minutes using reinforcement learning on a Donkey Car.

RL Baselines Zoo

A collection of 70+ pre-trained RL agents using Stable Baselines

S-RL Toolbox

S-RL Toolbox: Reinforcement Learning (RL) and State Representation Learning (SRL) for Robotics

Stable Baselines

A fork of OpenAI Baselines, implementations of reinforcement learning algorithms

Racing Robot

Autonomous Racing Robot With an Arduino, a Raspberry Pi and a Pi Camera

Arduino Robust Serial

A simple and robust serial communication protocol. Implementation in C Arduino, C++, Python and Rust.

Selected Publications

We evaluate the benefits of decoupling feature extraction from policy learning in robotics and propose a new way of combining state representation learning methods.
Submitted to ICLR, 2019

Recent Publications

. Decoupling feature extraction from policy learning: assessing benefits of state representation learning in goal based robotics. Submitted to ICLR, 2019.

Preprint Code Project

. S-RL Toolbox: Environments, Datasets and Evaluation Metrics for State Representation Learning. In Deep RL Workshop NIPS, 2018.

Preprint Code Project Video

. PythonRobotics: a Python code collection of robotics algorithms. 2018.

Preprint Code

. Unsupervised learning of state representations for multiple tasks. In Deep RL Workshop NIPS, 2016.

PDF Video

Recent Posts

Unified structure (scikit-learn like interface) and single codestyle with documentation

Arduino built-in functions for sending/receiving data are not very handy and sturdy. We introduce a protocol to communicate (using …


October 2018 – Present


German Aerospace Center (DLR)

Machine Learning for Robots.
October 2017 – October 2018

Research Engineer

ENSTA ParisTech - U2IS robotics lab

Working on Reinforcement Learning and State Representation Learning for the DREAM project.
April 2017 – September 2017

Research Intern


Deep Learning for Human Resources.
May 2016 – August 2016

Research Intern

TU Berlin - RBO lab

Research internship in representation and reinforcement learning.