Publications


Offline-Online Reinforcement Learning for Linear Mixture MDPs [arXiv] NeurIPS 2026
Zhongjun Zhang, Sean R. Sinclair.

Exploiting Exogenous Structure for Sample-Efficient Reinforcement Learning [arXiv] Under Review
Jia Wan, Sean R. Sinclair, Devavrat Shah, Martin Wainwright.
Presented at SIGMETRICS Workshop on Causal Inference (2025)
Presented at ICML Workshop on Aligning Reinforcement Learning Experimentalists and Theorists (2024)

Sequential Fair Allocation and Routing in Nonprofit Operations [arXiv] Under Review
Haiqing Gao, Seyed M.R. Iravani, Sean R. Sinclair.

Non-Stationary Inventory Control with Lead Times [arXiv] Under Review
Nele H. Amiri, Sean R. Sinclair, Maximiliano Udenio.

Is Pure Exploitation Sufficient in Exogenous MDPs with Linear Function Approximation? [arXiv] ICLR 2026
Hao Liang, Jiayu Cheng, Sean R. Sinclair, Yali Du.

Network and Risk Analysis of Surety Bonds [arXiv] Under Review
Tamara Broderick, Ali Jadbabaie, Vanessa Lin, Manuel Quintero, Arnab Sarker, Sean R. Sinclair.
Presented at International School & Conference on Network Science (2026)

Sequential Fair Allocation With Replenishments: A Little Envy Goes An Exponentially Long Way [arXiv] Under Review
Chido Onyeze, Sean R. Sinclair, Chamsi Hssaine, Siddhartha Banerjee.
Conference version published in ACM SIGMETRICS (2026)
Finalist for the 2026 INFORMS Service Science Best Paper Award
Winner of the 2026 ACM SIGMETRICS Best Paper Award
Presented at EC Workshop on New Directions in Social Choice (2025)

Reinforcement Learning in MDPs with Information-Ordered Policies [arXiv] Under Review
Zhongjun Zhang, Shipra Agrawal, Ilan Lobel, Sean R. Sinclair, Christina Lee Yu.
Finalist for the 2025 INFORMS George Nicholson Student Paper Competition

The Data-Driven Censored Newsvendor Problem [arXiv] Management Science 2026
Chamsi Hssaine, Sean R. Sinclair.
Accepted to Durham Early Career Scholars Workshop (2025)

Multi-Objective LQR with Linear Scalarization [arXiv] Under Review
Ali Jadbabaie, Devavrat Shah, Sean R. Sinclair.

Artificial Replay: A Meta-Algorithm for Harnessing Historical Data in Bandits [arXiv] Under Review
Siddhartha Banerjee, Sean R. Sinclair, Milind Tambe, Lily Xu, Christina Lee Yu.

Online Fair Allocation of Perishable Resources [Preprint] Operations Research 2026
Siddhartha Banerjee, Chamsi Hssaine, Sean R. Sinclair.
Runner-up for the 2024 INFORMS Service Science Best DEIJ Paper Competition
Media: Examining Algorithmic Fairness and Accountability
Conference version published in ACM SIGMETRICS (2023)
Conference version published in EAAMO (2022)
Presented at Simons Institute Data-Driven Decision Processes Program Workshop: Quantifying Uncertainty: Stochastic, Adversarial, and Beyond (2022)

Hindsight Learning for MDPs with Exogenous Inputs [arXiv] ICML 2023
Sean R. Sinclair, Felipe Frujeri, Ching-An Cheng, Luke Marshall, Hugo Barbalho, Jingling Li, Jennifer Neville, Ishai Menache, and Adith Swaminathan.

Adaptive Discretization in Online Reinforcement Learning [arXiv] Operations Research 2022
Sean R. Sinclair, Siddhartha Banerjee, and Christina Lee Yu.

ORSuite: Benchmarking Suite for Sequential Operations Models [ACM PER] SIGMETRICS Performance Evaluation Review 2021
Christopher Archer, Siddhartha Banerjee, Mayleen Cortez, Carrie Rucker, Sean R. Sinclair, Max Solberg, Qiaomin Xie and Christina Yu.
Presented at ACM SIGMETRICS Reinforcement Learning for Networks and Queues (2021)

Sequential Fair Allocation: Achieving the Optimal Envy-Efficiency Tradeoff Curve [arXiv] Operations Research 2022
Sean R. Sinclair, Gauri Jain, Siddhartha Banerjee, and Christina Lee Yu.
Earlier version accepted at SIGMETRICS (2022), also presented at Foundations of Responsible Computing Workshop (2022), ICJAI Workshop on AI for Social Good (2021), EC Workshop on Operations of People-Centric Systems (2021)
Finalist for the 2022 INFORMS Diversity, Equity, and Inclusion Best Student Paper Award
Presented at ACM FORC (2022)

Sequential Fair Allocation of Limited Resources under Stochastic Demands [arXiv]
Sean R. Sinclair, Gauri Jain, Siddhartha Banerjee, and Christina Lee Yu.
Presented at Harvard CRCS Workshop on AI for Social Good (2020), Mechanism Design for Social Good Workshop (2020)

Adaptive Discretization for Model-Based Reinforcement Learning [arXiv] [NeurIPS] NeurIPS 2020
Sean R. Sinclair, Tianyu Wang, Gauri Jain, Siddhartha Banerjee, and Christina Lee Yu.
Presented at ICML Workshop on Theoretical Foundations of Reinforcement Learning (2020)

Adaptive Discretization for Episodic Reinforcement Learning in Metric Spaces [arXiv] [ACM] [video] ACM POMACS 2019
Sean R. Sinclair, Siddhartha Banerjee, and Christina Lee Yu.
Conference version published in ACM SIGMETRICS (2020)
Presented at NeurIPS Workshop on Optimization in Reinforcement Learning (2019)

Normal and pathological dynamics of platelets in humans [arXiv] [springer] Journal of Mathematical Biology
GP Langlois, M Craig, AR Humphries, MC Mackey, et all.