Sabah Bushaj

We then extend the agent-based epidemiological simulation model of COVID-19 (Covasim) by adding new vaccination compartments representing people who take the first vaccine shot and the first two shots. The Covasim involves complex disease transmission contact networks, including households, schools, and workplaces, and demographics, such as age-based disease transmission parameters. We combine the extended Covasim with the vaccination center location-allocation MIP model into one single simulation-optimization framework, which works iteratively forward and backward in time to determine the optimal vaccine allocation under varying disease dynamics. The agent-based simulation captures the inherent uncertainty in disease progression and forecasts the refined number of susceptible individuals and infections for the current time period to be used as an input into the optimization. We calibrate, validate, and test our simulation-optimization vaccine allocation model using the COVID-19 data and vaccine distribution case study in New Jersey. The resulting insights support ongoing mass vaccination efforts to mitigate the impact of the pandemic on public health, while the simulation-optimization algorithmic framework could be generalized for other epidemics.

In this paper, we address the controversies of epidemic control planning by developing a novel Simulation-Deep Reinforcement Learning (SiRL) model. COVID-19 reminded constituents over the world that government decision-making could change their lives. During the COVID-19 pandemic, governments were concerned with reducing fatalities as the virus spread but at the same time also maintaining a flowing economy. In this paper, we address epidemic decision-making regarding the interventions necessary given of the epidemic based on the purpose of the decision-maker. Further, we intend to compare different vaccination strategies, such as age-based and random vaccination, to shine a light on who should get priority in the vaccination process. To address these issues, we propose a simulation-deep reinforcement learning (DRL) framework. This framework is composed of an agent-based simulation model and a governor DRL agent that can enforce interventions in the agent-based simulation environment. Computational results show that our DRL agent can learn effective strategies and suggest optimal actions given a specific epidemic situation based on a multi-objective reward structure. We compare our DRL agent’s decisions to government interventions at different periods of time during the COVID-19 pandemic. Our results suggest that more could have been done to control the epidemic. In addition, if a random vaccination strategy that allows super-spreaders to get vaccinated early were used, infections would have been reduced by 32% at the expense of 4% more deaths. We also show that a behavioral change of fully quarantining 10% of the risky individuals and using a random vaccination strategy leads to a reduction of the death toll by 14% and 27% compared to the age-based vaccination strategy that was implemented and the New Jersey reported data, respectively. We have also demonstrated the flexibility of our approach to be applied to other locations by validating and applying our model to the COVID-19 case in the state of Kansas.

We derive a nested risk measure for a maximization problem and implement it in a scenario-based formulation of a multi-stage stochastic mixed-integer programming problem. We apply the risk-averse formulation to the surveillance and control of a non-native forest insect, the emerald ash borer (EAB), a wood-boring beetle native to Asia and recently discovered in North America. Spreading across the eastern United States and Canada, EAB has killed millions of ash trees and cost homeowners and local governments billions of dollars. We present a mean-Conditional Value-at-Risk (CVaR), multi-stage, stochastic mixed-integer programming model to optimize a manager’s decisions about surveillance and control of EAB. The objective is to maximize the benefits of healthy ash trees in forests and urban environments under a fixed budget. Combining the risk-neutral objective with a risk measure allows for a trade-off between the weighted expected benefits from ash trees and the expected risks associated with experiencing extremely damaging scenarios. We define scenario dominance cuts (sdc) for the maximization problem and under the decision-dependent uncertainty. We then solve the model using the sdc cutting plane algorithm for varying risk parameters. Computational results demonstrate that scenario dominance cuts significantly improve the solution performance relative to that of CPLEX. Our CVaR risk-averse approach also raises the objective value of the least-benefit scenarios compared to the risk-neutral model. Results show a shift in the optimal strategy from applying less expensive insecticide treatment to more costly tree removal as the manager becomes more risk-averse. We also find that risk-averse managers survey more often to reduce the risk of experiencing adverse outcomes.