Antoine Moulin

Hi, I am a PhD student in reinforcement learning (RL). My aim is to gain a deeper understanding of the challenges posed by large-scale RL by identifying and exploiting structural properties of Markov decision processes (MDPs) that make large-scale learning statistically and computationally feasible.

More specifically, I am interested in efficiently solving the exploration-exploitation tradeoff in infinite-horizon MDPs under (linear) function approximation. My research interests also include: online learning, offline reinforcement learning, representation learning, and more broadly learning theory.

I am co-advised by Gergely Neu and Arthur Gretton. You can reach out to me at: firstname [dot] lastname [at] upf [dot] edu.

CV  /  Twitter  /  Github

• 10/2024 - The virtual RL theory seminars are back, join us for the new season!
• 07/2024 - We are organizing an ICML workshop on RL, check it out :)
• 06/2024 - I am moving to London to intern and work on uncertainty quantification. Specifically, I'll focus on computing finite-time predictive confidence intervals for general function classes.
• 08/2023 - I'm going to the ELLIS symposium later this month. See you in Helsinki!
• 07/2023 - I'll present our ICML paper at EWRL16, in Brussels.
• 04/2023 - Our paper "Optimistic Planning by Regularized Dynamic Programming" has been accepted at ICML 2023. See you in Hawaii!
show more
04/2023 - I am attending AISTATS 2023 in Valencia, Spain.
10/2022 - We are organizing RLSS 2023, that will take place in June 2023.
09/2022 - I will stay in London for a week to visit the Gatsby unit at UCL.
09/2022 - I will be in Milan, Italy to attend EWRL 2022.
07/2022 - I am staying in Amsterdam, Netherlands for a week to attend a reinforcement learning summer school (RLSS 2022)!
03/2022 - I am in Paris to attend ALT 2022.
12/2021 - I am now officially a PhD student at University Pompeu Fabra.
10/2021 - With Luca Viano, we are now organizing a reading group about RL with other people from the ELLIS network.
10/2021 - This month, I was in Tübingen, Germany for the ELLIS Doctoral Symposium (EDS) 2021 to meet with the ELLIS cohort, discuss research, and give an introduction to JAX. Amazing event!