Reinforcement learning & robotics

Alexandre Brown

Scaling unsupervised RL
for humanoids.

I'm a PhD student at Université de Montréal (UdeM) and a researcher at Mila - Quebec AI Institute and the Robotics and Embodied AI Lab (REAL), advised by Glen Berseth.

I study RL pretraining for humanoid loco-manipulation. I'm interested in general learning and search methods that scale with compute and autonomous experience, following the Bitter Lesson.

Portrait of Alexandre Brown
PhD student at UdeM · Researcher at Mila

SegDAC accepted at RLC 2026

Published in Reinforcement Learning Journal, volume 7. Presented in a conference talk and poster session in Montréal.

Learning from experience.
Transferring zero-shot.

My goal is to build behavior foundation models that learn useful skills before a task is specified. I focus on large-scale unsupervised RL and zero-shot transfer for humanoid locomotion and manipulation, using RGB observations and minimal task-specific supervision.

My work on SegDAC studied visual generalization in RL. I now want to scale the capabilities robots can learn through interaction, with methods that keep improving as compute and experience grow.

  • Unsupervised RL pretraining
  • Zero-shot reinforcement learning
  • Vision-based humanoid control
All publications
More on GitHub
Wildfire risk prediction maps across Canada

Machine learning & remote sensing

Canada wildfire prediction

An end-to-end pipeline built from scratch for wildfire forecasting across Canada, from automated geospatial data downloads at scale and preprocessing to deep learning model training and evaluation.

Before my PhD, I worked in machine learning and software engineering, with projects in computer vision and remote sensing.

Education

2025–present

PhD in Computer Science

Université de Montréal

2024–2025

MSc in Computer Science

Université de Montréal

2021–2024

BSc in Computer Science

Université Laval

2015–2019

Technical DEC in Computer Science

Diploma of College Studies

Experience

Sep 2024–present

Graduate Student Researcher

Mila

May–Sep 2024

Data Scientist Intern

Intact

Nov 2023–May 2024

Python Teaching Assistant

Université Laval

Aug 2021–Oct 2023

Machine Learning Specialist

Microdrones

Jan 2019–Aug 2021

Software Engineering

Microdrones

Aug 2018–Jan 2019

Software Engineering

TELUS

A seated Unitree G1 wearing a Mila shirt
Unitree G1 at Mila
Unitree G1 beside a red ball in the robotics lab
Unitree G1 at the REAL lab
Franka Panda above a tabletop manipulation setup
Franka arm at the REAL lab