I am a PhD candidate funded by NSFGRFP at Princeton Neuroscience Institute working in the Daw lab and Witten lab. My broad research interests are in Computational Cognitive Neuroscience, with a focus on modeling and theory. These days I work on Dopaminergic Models of Reinforcement Learning.

EDUCATION

PhD.Candidate Neuroscience (Daw Lab and Witten Lab), Princeton University 2017-current

M.A. Neuroscience Princeton University

B.S. Mathematical Computation Science Stanford University 2011-2015

POSTERS AND PUBLICATIONS

Explaining dopaminergic response heterogeneity via high-dimensional value function approximation. Lee, R., Engelhard, B., Witten, I. B., & Daw, N. D. (2021). Poster at COSYNE 2021.

Reconciling Heterogeneous Dopaminergic Responses with Reward Prediction Error Models Lee, R., Engelhard, B., Witten, I.B., Daw, N.D. (2019). Poster at Reinforcement Learning and Decision Making 2019, Montreal.

Reward prediction error does not explain movement selectivity in DMS-projecting dopamine neurons. Lee, R. S., Mattar, M. G., Parker, N. F., Witten, I. B., & Daw, N. D. (2019). Elife

Dopamine neurons targeting Dorsomedial Striatum are modulated by reward and choice independently. Lee, R., Mattar, M.G., Parker, N.F., Witten, I.B., Daw, N.D. (2018). Poster at Society of Neuroscience 2018, San Diego.

The effect of pooling in a deep learning model of perceptual learning. Lee, R., Saxe, A. (2015) Poster at COSYNE 2015, Salt Lake City.

Modeling perceptual learning with deep networks. Lee, R., Saxe, A., McClelland, J. L. (2014). Poster at CogSci 2014, Quebec City, Canada.

INVITED TALKS

Pavlovian Society Annual Meeting (2021). Invited speaker for Symposium “The increasingly diverse role of midbrain dopamine neurons in reinforcement learning.”

Bernstein Conference (2021). Invited speaker and panelist for Workshop “Distributed Representation in RL From AI to Dopamine.”

O’Doherty Lab, California Institute of Technology. (2021)

AWARDS AND GRANTS

RLDM Student Travel Grant. 2019.
National Science Foundation Graduate Research Fellowship. 2019.
Center of Brain Minds and Machines Summer Course. 2018.
Bachelor’s degree awarded with Distinction (Top 15% of graduating class). 2015.
Computational and Systems Neuroscience Conference Undergraduate Travel Grant. 2015.
Stanford Undergraduate Research and Advising Major Grant. 2014.
Stanford Symbolic Systems Undergraduate Summer Research Grant. 2013.
Stanford Bio-X Undergraduate Summer Research Grant. 2013.
Stanford STEM Fellowship Nominee. 2013.