Avatar

Sanket Shah

PhD Student

Harvard University

I am a fourth-year PhD student at Harvard University advised by Prof. Milind Tambe. My current work focuses on Decision-Focused Learning, a paradigm for tailoring a predictive model for a downstream optimization task that uses its predictions.

Previously, I was Research Engineer at Singapore Management University (SMU) advised by Prof. Pradeep Varakantham where I used Reinforcement Learning to solve problems in Transportation and Security. I also spent a year at Microsoft Research India during which I worked on Information and Communications Technology for Development (ICTD) with Dr. Colin Scott and Dr. Bill Thies and Natural Language Processing with Dr. Sundararajan Sellamanickam.

Interests

  • Algorithmic Decision-Making
  • AI for Social Good
  • Machine Learning
  • Reinforcement Learning

Education

  • Ph.D. in Computer Science, 2020 - Present

    Harvard University

  • B.E. (Hons.) in Computer Science, 2017

    Birla Institute of Technology and Science, Pilani

Recent Publications

Efficient Public Health Intervention Planning Using Decomposition-Based Decision-Focused Learning

We propose an efficient way to implement decision-focused learning for the kinds of RMABs used for intervention planning in public health.

Leaving the Nest: Going Beyond Local Loss Functions for Predict-Then-Optimize

We propose two new innovations to help improve the learning of task-specific loss functions.

Decision-Focused Learning in Restless Multi-Armed Bandits with Application to Maternal and Child Care Domain

We propose a way to differentiate through MDP Planning for Restless Multi-Armed Bandits. We use this approach to better learn the Transition Matrices from “features” associated with different arms using Decision-Focused Learning.

Decision-Focused Learning without Decision-Making: Learning Locally Optimized Decision Losses

We learn task-specific loss functions that, when trained on, allow a predictive model to make better predictions for the given task.

Joint Pricing and Matching for City-Scale Ride-Pooling

We learn how to price in ride-pooling (UberPool) while taking into account the matchings the pricing system induces.

Recent Posts

My Ride-pooling Journey

A blog post about the joyride my paper ‘Neural Approximate Dynamic Programming for On-Demand Ride-Pooling’ took me on.