Simon K. Schnyder
skschnyder@gmail.comInstitute of Industrial Science, The University of Tokyo,
4-6-1 Komaba, Meguro-ku, Tokyo 153-8505, Japan
John J. Molina
Department of Chemical Engineering, Kyoto University, Kyoto 615-8510, Japan
Ryoichi Yamamoto
Department of Chemical Engineering, Kyoto University, Kyoto 615-8510, Japan
Matthew S. Turner
m.s.turner@warwick.ac.ukDepartment of Physics, University of Warwick, Coventry CV4 7AL, UK
Institute for Global Pandemic Planning, University of Warwick, Coventry CV4 7AL, UK
(July 5, 2024)
Abstract
Faced with a dangerous epidemic humans will spontaneously social distance to reduce their risk of infection at a socio-economic cost.
Compartmentalised epidemic models have been extended to include this endogenous decision making:
Individuals choose their behaviour to optimise a utility function, self-consistently giving rise to population behaviour.
Here we study the properties of the resulting Nash equilibria, in which no member of the population can gain an advantage by unilaterally adopting different behaviour.
We leverage a new analytic solution to obtain,
(1) a simple relationship between rational social distancing behaviour and the current number of infections;
(2) new scaling results for how the infection peak and number of total cases depend on the cost of contracting the disease;
(3) characteristic infection costs that divide regimes of strong and weak behavioural response and depend only on the basic reproduction number of the disease;
(4) a closed form expression for the value of the utility.
We discuss how these analytic results provide a deep and intuitive understanding into the disease dynamics,
useful for both individuals and policymakers.
In particular the relationship between social distancing and infections represents a heuristic that could be communicated to the population to encourage, or “bootstrap”, rational behaviour.
Throughout history, epidemics caused by infectious diseases have caused considerable harm to humans. Individuals
are typically assumed to be able to adjust their behaviour in reaction to the threat of an epidemic [1, 2, 3, 4, 5, 6, 7, 8, 9, 10].
In order to make choices about their behaviour individuals can weigh the costs and benefits of the outcomes of their behaviour. They may reduce their social activity when infections are high, in order to reduce the probability of becoming infected themselves, provided that the health costs outweigh the social and economic costs. A common assumption is that individual agents act rationally, i.e. to maximise an objective function or economic utility.
This remains one of the fundamental assumptions of modern economic theory despite its limitations [11].
Rational individuals, who aim to maximise their individual objective function, end up targeting a Nash equilibrium [1, 9, 2, 12, 13] rather than the global utility maximum, which requires a coordinated effort to maximise a collective objective function
[14, 15, 7, 16].
Our work directly builds on this approach. It is possible to bring a Nash equilibrium into alignment with the global optimum [14, 17, 18, 19], e.g. via tax and subsidy incentives [20] which can be designed to bias rational individual behaviour appropriately.
While these studies tend to employ highly stylised mean-field compartmentalised models, they demonstrate the feasibility of such approaches.
Such models can be extended to more accurately represent the complexity of epidemics and the systems in which they occur, such as
additional compartment types with different risk and behaviour profiles [21, 2, 22, 23, 24, 25], seasonal effects [26], waning immunity [27, 25] e.g. due to new variants [28], as well as spatial, transmission or behavioural heterogeneity [29, 30, 22, 31, 32]. Other approaches feature spatial [33] and temporal networks [34, 35], and/or agent-based models [36, 37, 38, 39].
Others have worked to incorporate uncertainty and noise, by considering stochastic control [40, 41, 42, 43, 44],
decision making under uncertainty [45, 46] and by understanding the robustness of control [47, 48, 49]. There have also been studies on inferring model structure and epidemiological properties from observed data [50, 51, 52, 53]. Finally, we also remark on the intriguing possibility of allowing individual opinions to directly influence policy makers [54].
Nash equilibria are widely believed to occur within such idealised models that incorporate endogenous behaviour during epidemics. However, until this work, solutions have only been accessible numerically. This is because the problem is intrinsically nonlinear, both at the level of the epidemiological dynamics and the objective function, leading to nonlinear control equations. Here, we provide for the first time, an analytic solution to the nonlinear time-dependent equilibrium control equations. This also demonstrates the existence of such a Nash equilibrium. In the limit of vanishing infection cost our results trivially recover the known analytic solutions for compartment models with constant basic reproduction number [55, 56, 57, 58, 59], i.e. without endogenous rational behaviour.
We focus on the case where the cost of infection is constant and where the government takes no role in directing the response to the epidemic. This situation has been already discussed, e.g. by [1] among many others, but only using numerical solutions. We do not investigate other possible policy interventions such as vaccination and treatment strategies, [60, 61, 62, 63, 9, 64, 3, 37, 4, 15, 39, 65, 66, 67, 25, 68], or isolation, testing, and active case-tracing strategies [69, 70]. We also ignore the situation where a vaccine becomes available during the epidemic. While the early arrival of a vaccine would have consequences for both equilibrium and globally optimal behaviour [1, 7, 13, 71], this lies outside of the scope of this work.
1 Epidemic dynamics
We use a standard SIR compartmentalised model [55] for the epidemic. The population is divided into susceptible, infected and recovered compartments, the latter implicitly including fatalities. The compartments evolve over time as
(1)
(2)
Here a dot denotes a time derivative and the time dependence of , , and is omitted for brevity. We normalise the compartments, .
We use one timescale for both recovery and the duration of infectiousness, for simplicity, and have rescaled the equations so that time is measured in units of this single timescale.
The initial conditions are set as , , , with and .
In all figures we arbitrarily select a time origin where the epidemic is in its very early stages according to
with .
The population’s average social activity behaviour is encoded in the current infection rate, assumed to satisfy although our analytic results later suggest a stronger bound .
We assume that the disease exhibits a natural level of activity in the absence of any behavioural modification that is a constant known as the basic reproduction number . Below we use the case to establish a non-behavioural baseline dynamics for comparison.
2 Nash equilibrium behaviour
In order to study self-organised behaviour, we imagine an average individual making decisions about their own behaviour. This represents a mean-field game [72, 73], for the Nash equilibrium of which a set of ordinary differential equations can be straightforwardly derived [74, 9].
The individual’s effect on the epidemic is negligible but they can influence their own fate by selecting a strategy which it is initially assumed can differ from the population-averaged strategy .
The probabilities that an individual is in each of the compartments evolves over time according to
(3)
(4)
Lowering directly increases the probability of the individual remaining susceptible and reduces their probability of becoming infectious.
While these equations are similar to eqs. 2, they couple to the infectious compartment of the population as the only donor of infection.
We assume that an individual has rational interests that can be captured by an objective function or utility. In general this will depend on both their own and the population behaviours, . The individual seek to maximise this objective function. Assuming that the population consist of identical individuals, a Nash equilibrium exists if there is a strategy , adopted by the population, and the individual cannot improve their outcome by unilaterally deviating from the behaviour ,
(5)
In order to find this Nash strategy one first maximises over for an arbitrary, exogenous [9]. This constitutes a standard constrained optimisation problem. To make the strategy self-consistent, one then assumes that all individuals in the population would optimise their behaviour in the same way, and therefore . This then automatically results in , with dynamics that corresponds to the Nash equilibrium.
In this work, we focus on an idealised individual objective function or utility with, see ref. 19,
(6)
(7)
The average infection cost is given by (this also includes the cost of death) with .
The social and financial costs of social distancing are parametrised by a constant . In what follows we choose to work in units of utility in which , without loss of generality. The quadratic form of this social distancing term encodes that it is costly to deviate from one’s default behaviour and ensures that an individual would naturally select behaviour corresponding to if there were no epidemic (or it bore no cost).
Motivated by the observation that no individual, regardless of compartment, can socially distance without incurring a cost, we assume that the cost of social distancing always applies, in contrast to other work, e.g. [1, 15] where the cost of social distancing is paid mostly by the -compartment. Our choice corresponds to an approximation in which individuals are uncertain about which compartment they find themselves in, e.g. when infections can be asymptomatic.
In general one might truncate the utility integral at a final time . One approach here is to assuming that at that time the susceptible compartment becomes completely and perfectly vaccinated. The cost of being infected when the vaccine becomes available is expressed as a so-called salvage term , see section6.1 for a derivation. If is comparable to or shorter than the duration of the epidemic then it can have a qualitative effect on rational decision-making
and thus the course of the epidemic [1, 7, 71]. However, this lies outside of the scope of this work, and so we choose . In this case,
vaccination plays no role in decision making and .
Since the utility function is convex, we expect that the optimisation problem has a (unique) solution. We directly demonstrate uniqueness and existence by calculating the analytic solution to this problem below.
We use a standard Hamiltonian/Lagrangian approach [74, 9], which in optimal control theory is referred to as Pontryagin’s maximum principle [75],
to calculate the optimal behaviour of an individual in response to an exogenous behaviour and the corresponding course of the epidemic.
This approach allows for reformulating the optimisation problem as a boundary value problem which is generated from an auxiliary function, the Hamiltonian. The Hamiltonian for the individual can be expressed by
(8)
(9)
(10)
The Lagrange fields and , expressing the expected present value of the utility of being in each compartment at each point in time [9] enforce the constraint of the dynamics to eqs. (4).
Their equations of motion are
(11)
(12)
with boundary conditions
(13)
Given the exogenous course of the epidemic in the population, the individual can optimise their own utility be choosing the strategy that satisfies . From this we obtain
.
Assuming that the population consist entirely of identical individuals who would all independently from each other choose the same strategy, we can conclude that the average population behaviour must be self-consistently given by . Hence, this gives rise to a Nash equilibrium. Then, naturally also and , and
(14)
The variational approach as stated only yields conditions sufficient to identify extrema. To confirm that a solution is a maximum, is required. Here we find .
3 Analytic solution
The Nash equilibrium optimising the utility
eq.6
is given by the solution of eq.2,
eqs.11, 12 and 13, in conjunction with the optimality condition eq.14.
From here, we calculate the analytic solution for this set of equations. We assume the case without economic discounting, .
Firstly, we work with the integrated fraction of infected cases up to time , i.e. the fraction of recovered cases , defined as
(15)
noting that . In what follows it is convenient to consider an implicit form for the behaviour . Because is monotonic we can rely on a one-to-one mapping between and .
The second transformation involves defining
,
hence obeys
Recalling our assumption that , we can conclude that .
In this limit the cumulative total of infections reaches its final value given by the non-zero root of
(20)
Equations15, 16, 17, 18, 19 and 20 above hold irrespective of the form of the objective function.
Figure 1: Direct plots of the analytic solution.
(a) The analytic solution of the Nash equilibrium social distancing problem as obtained in eq.28 as a function of the recovered for an exemplary range of infection costs and .
Initial conditions here and in all following figures are set to and .
(b) The fraction of infectious as a function of the susceptible for the same range of .
(c) Deviation of the social distancing behaviour from the pre-epidemic default as a function of , emphasising their linear relationship as established in eq.24.
Concerning the Lagrange fields, we can see directly from eq.12 that , whereas
follows from eq.11
(21)
Integrating we obtain
(22)
with a constant .
From the boundary condition we can conclude
(23)
with .
The optimal behaviour is then given by eq.14
(24)
This is tremendously simple: the equilibrium strength of social distancing is proportional to both the number of infectious cases and the cost of infection at any given time, see fig.1c.
With we have
with and .
This has an analytic solution that satisfies
(28)
Using , we can self-consistently determine and thus obtain the solution.
We show the result of eq.28 for a range of infection costs in fig.1a.
The analytic solution for the infectious compartment can be plotted in a natural way on the s-i plane, see fig.1b.
In our approach, time is parametrised as eq.19,
which can easily be evaluated numerically. The analytic solution can then be plotted in the typical way, fig.2.
Figure 2: Analytic solution as a function of time. (a) Equilibrium social activity behaviour of the population and corresponding dynamics of the disease (b) and (c) for an exemplary range of infection costs and .
Since infections incur a cost, the equilibrium behaviour seeks to avoid excessive infections by self-organised social distancing. The higher the cost, the more reduced social activity becomes.
Figure 3: Scaling.
(a) Excess cases vs. infection cost for a range of basic reproduction numbers . The high infection cost asymptotes, see eq.34, are shown as dashed lines and the crossover costs , see eq.36, as black stars.
Inset: The data collapses onto the low- and high infection cost asymptotes by rescaling the cost with the crossover cost , see eq.36, while rescaling with its non-behavioural limit, see eq.32.
(b) The infection peak vs. for a range of . The high infection cost asymptotes, see eq.35, are shown as dashed lines and the crossover costs , see eq.37, as grey stars.
Inset: The data collapses onto the low- and high infection cost asymptotes by rescaling the cost with the crossover cost , eq.37, while rescaling the peak height with its non-behavioural limit, see eq.33.
Figure 4: Behavioural response.
Characterisation of the Nash equilibrium response in the – parameter space. On the high – low- side of the line, the behaviour is well represented by the non-behavioural limit, in which it is not rational to significantly modify one’s behaviour. On the low – high infection cost side, it is rational to strongly modify one’s behaviour. The lines describing the crossover are given by the critical costs for the transition in the excess cases, see eq.36, and/or for the transition in the infection peak, see eq.37.
The parameter values used for some of the curves in figs.2 and 1 are marked by analogously coloured dots.
4 Results
The higher the infection cost , the stronger is the incentive to reduce social activity and hence , see fig.2. The stronger the reduction in , the more slowly the epidemic progresses, the lower the peak infection levels are, and the higher the total number of cases becomes.
In what follows, we analyse the epidemic using two key quantities, the excess cases and the peak of the epidemic .
For , herd immunity is always reached. The final number of susceptibles then always satisfies
, with the minimum number of cases for which herd immunity is guaranteed.
The cases in excess of this threshold are defined as
(29)
We will calculate and in two limiting cases:
(1) The Non-behavioural limit in which there is no perceived infection cost . In this case there is no reason to modify one’s behaviour, , see purple lines in figs.1 and 2.
(2) The high-infection-cost asymptote in which infection costs are very high, .
By matching these solutions we will obtain crossover costs between these scaling results.
Non-behavioural limit
For this edge case only, the analytic solution was known previously [55, 56, 57, 58, 59].
We recover it in our notation as follows.
Since , eq.27 is solved by
(30)
Its limit
yields
(31)
with the product logarithm .
Hence,
(32)
The peak of the epidemic occurs at the time for which and thus
, see eq.2. Inserting this and into eq.30, we obtain
(33)
High-infection-cost asymptote
The final number of cases can be calculated in the limit of large , where with small and assuming that . We obtain
(34)
from an expansion of eq.28 in both and small and by matching order by order. This result is satisfied well, see fig.3a.
For the peak height, we obtain in the same limit, see section6.2 for the calculation,
Observing in fig.3a that the excess cases are roughly constant at low and therefore well described by the non-behavioural limit, we obtain a crossover cost at which the non-behavioural and high infection cost asymptotes of eqs.32 and 34, respectively, match
(36)
For the infection peak, we similarly obtain a crossover cost from matching eqs.33 and 35
(37)
These crossover values and the non-behavioural limits for and can be used to achieve complete collapse of and onto master curves, see fig.3b and fig.3d, respectively.
Both crossover values, and , determine different aspects of the “phase diagram” of social distancing, see fig.4.
The crossover for the infection peak describes a behavioural transition in the most intuitive signal of an epidemic.
The infection peak also corresponds to the most restrictive value of social distancing, see eq.24. For social distancing is extremely weak, see e.g. for in fig.2a (For , and ).
Social distancing is ultimately aimed at reducing excess cases. For there is social distancing, but still only on a relatively short time frame, see the data for in fig.2a.
It starts to visibly affect the peak of the epidemic but not its duration, fig.2c, and has a very limited effect on the total of cases, fig.2b. This can be a viewed as the consequence of low gearing between the drop in infectivity and excess cases.
Only for is there considerable social distancing for an extended time, which then achieves a significant reduction in excess cases.
Figure 5: Cost of the epidemic.
Total epidemic cost relative to the cost of an infection, , as a function of infection cost under equilibrium social distancing. The corresponding non-behavioural, eq.39, and high-infection-cost asymptotes, eq.40 are indicated by dotted and dashed lines, respectively.
Utility
The utility, eq.6, evaluated at the equilibrium behaviour can be directly calculated using the analytic solution
(38)
noting that and depend on and . The total infection cost is given by with the remainder being the total social distancing cost. Especially for intermediary and high infection costs , equilibrium behaviour strongly reduces the total epidemic cost, see fig.5.
Again, we investigate the two limiting cases: For low , we obtain with
eq.31
(39)
For high , i.e. , with
, we obtain
(40)
5 Discussion and conclusion
In summary, we have identified an analytic solution
for the Nash equilibrium behaviour for social distancing during an epidemic.
We leveraged this solution to obtain
(1) a simple relationship between the strength of rational social distancing and the current number of cases, eq.24;
(2) scaling results for the total number of cases, eq.34, and
the infection peak, eq.35
which only depend on the basic reproduction number and the cost of contracting the disease;
(3) characteristic infection costs, eqs.36 and 37, that divide regimes of strong and weak social distancing and depend only on the basic reproduction number of the disease;
(4) a closed form expression for the value of the utility, eq.38.
These four results represent a remarkable simplification of a complex optimisation problem.
We believe our work to be useful to policy makers because it yields a simple, albeit idealised, classification of the impact of self-organised social distancing during epidemics and thus can serve as guide for policy.
Given the basic reproduction number of a given disease and its estimated cost of infection , we show that one can either expect negligible social distancing from the population, when the infection cost is below a characteristic cost, or substantial social distancing when it is above.
There is an ongoing debate about the degree to which behaviour of individuals is truly rational, as we (and others) assume. In this context our most significant result is that the rational decision making process seems to be intuitively accessible to most members of the population: rational social distancing is proportional to the infection cost and to the current number of cases.
It is remarkable that the rational response we derive can be condensed into such a simple heuristic, understandable to a typical member of the population. While it may indeed be a challenge for such individuals to derive our results for themselves, a policymaker could communicate this simple heuristic, to be adopted by the population in order to assist them in targeting truly rational behaviour. It is not unrealistic to expect this advice to influence the population decision making, especially given that it can be shown to be in each individual’s self interest. In this sense the present work may itself help to “bootstrap” such rational behaviour.
While rational behaviour is not the mathematically optimal solution that maximises utility, as would be accessible under arbitrarily precise government control, it is relatively close to it. Rational behaviour also has the advantage of being stable, in the sense that it suppresses the detrimental behaviour of freeloaders, who are worse off if they deviate from the Nash equilibrium behaviour. The fact that rational behaviour is so desirable means that new tools that enable policymakers to help individuals target rational behaviour, like the ones we provide here, may be extremely valuable.
6 Methods
6.1 Vaccination salvage term
A perfect vaccine applied to the whole population at time corresponds to immediately moving the susceptible fraction of the population into the recovered compartment, and . Eqs. (2) reduce to
(41)
The remaining infectious recover exponentially, with ,
(42)
Analogously for the individual probabilities, with ,
(43)
Since nobody can get freshly infected, the population selects pre-epidemic behaviour, . The contribution to the utility that arises from the recovery process after can be written in analogy to eq.7
This can be integrated to yield
(44)
6.2 High-infection cost asymptote for the infection peak height
large according to . The infection peak occurs at where eq.2 yields .
Using eq.24 we have
(46)
with the sum rule,
(47)
(48)
This yields a quadratic equation for with physical root
(49)
(50)
(51)
For large the infection peak occurs early in the epidemic, when ,
e.g. see fig.1 for . Using eq.45 and recalling also that we find
(52)
Acknowledgements.
We would like to dedicate this work to the memory of Prof. George Rowlands, who passed away in early 2021 and who was involved in many of the early discussions leading to this work.
We thank Paul François, Shuhei Horiguchi, Tetsuya J. Kobayashi, and Takehiro Tottori for helpful discussions.
This work was supported by the Grants-in-Aid for Scientific Research (JSPS KAKENHI) under Grants No. 20H00129 (RY), 20H05619 (RY), 22H04841 (SKS), 22K14012 (SKS), 23H04508 (JJM), and the JSPS Core-to-Core Program “Advanced core-to-core network for the physics of self-organizing active matter” JPJSCCA20230002 (all of us). MST acknowledges the generous support of visiting fellowships from JSPS Fellowship, ID L19547, the Leverhulme Trust, Ref. IAF-2019-019, and the kind hospitality of the Yamamoto group.
The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
The authors declare that there are no conflicts of interest.
Author contributions: All authors designed the research. SKS and MST performed the research. JJM assisted with code development and numerical methods. All authors wrote the paper.
Fenichel et al. [2011]E. P. Fenichel, C. Castillo-Chavez, M. G. Ceddia, G. Chowell,
P. A. G. Parra, G. J. Hickling, G. Holloway, R. Horan, B. Morin, C. Perrings, M. Springborn, L. Velazquez, and C. Villalobos, Adaptive human behavior in epidemiological models, Proc. Natl. Acad. Sci. 108, 6306 (2011).
Wang et al. [2016]Z. Wang, C. T. Bauch,
S. Bhattacharyya, A. D’Onofrio, P. Manfredi, M. Perc, N. Perra, M. Salathé, and D. Zhao, Statistical physics of vaccination, Physics Reports 664, 1 (2016), arXiv:1608.09010 .
Verelst et al. [2016]F. Verelst, L. Willem, and P. Beutels, Behavioural change models for
infectious disease transmission: A systematic review (2010-2015), Journal of the Royal Society
Interface 13, 10.1098/rsif.2016.0820 (2016).
Reluga and Galvani [2011]T. C. Reluga and A. P. Galvani, A general approach for
population games with application to vaccination, Math. Biosci. 230, 67 (2011).
Kahneman [2003]D. Kahneman, Maps of bounded
rationality: Psychology for behavioral economics, American economic review 93, 1449 (2003).
McAdams [2020]D. McAdams, Nash SIR: An
Economic-Epidemiological Model of Strategic Behavior During a Viral
Epidemic, Covid Economics 10.2139/ssrn.3593272
(2020).
Rowthorn and Toxvaerd [2020]R. Rowthorn and F. Toxvaerd, The optimal control
of infectious diseases via prevention and treatment, Cambridge Working Papers in Economics 2027 (University of Cambridge, 2020).
Toxvaerd and Rowthorn [2020]F. Toxvaerd and R. Rowthorn, On the management of
population immunity, Cambridge Working Papers in
Economics 2080 (University of
Cambridge, 2020).
Li et al. [2017]J. Li, D. V. Lindberg,
R. A. Smith, and T. C. Reluga, Provisioning of Public Health Can Be Designed to
Anticipate Public Policy Responses, Bull. Math. Biol. 79, 163 (2017).
Bethune and Korinek [2020]Z. A. Bethune and A. Korinek, COVID-19 infection
externalities: trading off lives vs. livelihoods, Working Paper 27009 (National Bureau of Economic Research, Cambridge, MA, 2020).
Prem et al. [2017]K. Prem, A. R. Cook, and M. Jit, Projecting social contact matrices in 152
countries using contact surveys and demographic data, PLOS Computational Biology 13, e1005697 (2017).
Huang et al. [2022]C. I. Huang, R. E. Crump,
P. E. Brown, S. E. Spencer, E. M. Miaka, C. Shampa, M. J. Keeling, and K. S. Rock, Identifying regions for enhanced control of gambiense sleeping sickness in
the Democratic Republic of Congo, Nature Communications 13, 1 (2022).
Tildesley et al. [2022]M. J. Tildesley, A. Vassall,
S. Riley, M. Jit, F. Sandmann, E. M. Hill, R. N. Thompson, B. D. Atkins, J. Edmunds, L. Dyson, and M. J. Keeling, Optimal
health and economic impact of non-pharmaceutical intervention measures prior
and post vaccination in England: a mathematical modelling study, Royal Society Open Science 9, 10.1098/rsos.211746 (2022).
Keeling et al. [2022]M. J. Keeling, L. Dyson,
M. J. Tildesley, E. M. Hill, and S. Moore, Comparison of the 2021 COVID-19 roadmap projections
against public health data in England, Nature communications 13, 4924 (2022).
He et al. [2013]D. He, J. Dushoff,
T. Day, J. Ma, and D. J. Earn, Inferring the causes of the three waves of the 1918 influenza
pandemic in England and Wales, Proceedings of the Royal Society B: Biological Sciences 280, 10.1098/rspb.2013.1345 (2013).
Schwarzendahl et al. [2022]F. J. Schwarzendahl, J. Grauer, B. Liebchen, and H. Löwen, Mutation induced infection waves in
diseases like COVID-19, Scientific Reports 12, 1 (2022).
Mossong et al. [2008]J. Mossong, N. Hens,
M. Jit, P. Beutels, K. Auranen, R. Mikolajczyk, M. Massari, S. Salmaso, G. S. Tomba, J. Wallinga, J. Heijne,
M. Sadkowska-Todys,
M. Rosinska, and W. J. Edmunds, Social contacts and mixing patterns
relevant to the spread of infectious diseases, PLoS Medicine 5, 0381 (2008).
Sun et al. [2021]K. Sun, W. Wang, L. Gao, Y. Wang, K. Luo, L. Ren, Z. Zhan, X. Chen, S. Zhao, Y. Huang, Q. Sun, Z. Liu, M. Litvinova,
A. Vespignani, M. Ajelli, C. Viboud, and H. Yu, Transmission heterogeneities, kinetics, and controllability of
SARS-CoV-2, Science 371, eabe2424 (2021).
Hill et al. [2023]E. M. Hill, N. S. Prosser,
P. E. Brown, E. Ferguson, M. J. Green, J. Kaler, M. J. Keeling, and M. J. Tildesley, Incorporating heterogeneity in farmer disease control behaviour into a
livestock disease transmission model, Preventive Veterinary Medicine 219, 106019 (2023).
Holme and Masuda [2015]P. Holme and N. Masuda, The basic reproduction number as a
predictor for epidemic outbreaks in temporal networks, PLoS ONE 10, 1 (2015), arXiv:1407.6598 .
Ferguson et al. [2006]N. M. Ferguson, D. A. T. Cummings, C. Fraser,
J. C. Cajka, P. C. Cooley, and D. S. Burke, Strategies for mitigating an influenza pandemic, Nature 442, 448 (2006).
Mellacher [2020]P. Mellacher, COVID-Town: An
Integrated Economic-Epidemiological Agent-Based Model, GSC discussion papers 23 (Graz Schumpeter Centre, 2020).
Grauer et al. [2020]J. Grauer, H. Löwen, and B. Liebchen, Strategic
spatiotemporal vaccine distribution increases the survival rate in an
infectious disease like Covid-19, Scientific Reports 10, 1 (2020), arXiv:2005.04056 .
Yong and Zhou [1999]J. Yong and X. Y. Zhou, Stochastic controls:
Hamiltonian systems and HJB equations, Vol. 43 (Springer Science & Business Media, 1999).
Lorch et al. [2018]L. Lorch, A. De, S. Bhatt, W. Trouleau, U. Upadhyay, and M. Gomez-Rodriguez, Stochastic Optimal Control of Epidemic Processes in
Networks, (2018), arXiv:1810.13043
.
Tottori and Kobayashi [2022]T. Tottori and T. J. Kobayashi, Memory-Limited
Partially Observable Stochastic Control and Its Mean-Field Control
Approach, Entropy 24, 1 (2022), arXiv:2203.10682 .
Tottori and Kobayashi [2023a]T. Tottori and T. J. Kobayashi, Forward-Backward Sweep
Method for the System of HJB-FP Equations in Memory-Limited Partially
Observable Stochastic Control, Entropy 25, 10.3390/e25020208 (2023a).
Tottori and Kobayashi [2023b]T. Tottori and T. J. Kobayashi, Decentralized
Stochastic Control with Finite-Dimensional Memories: A Memory Limitation
Approach, Entropy 25, 1 (2023b).
Shea et al. [2023]K. Shea, R. K. Borchering, W. J. M. Probert, E. Howerton,
T. L. Bogich, S.-L. Li, W. G. van Panhuis, C. Viboud, R. Aguás, A. A. Belov, S. H. Bhargava, S. M. Cavany, J. C. Chang,
C. Chen, J. Chen, S. Chen, Y. Chen, L. M. Childs,
C. C. Chow, I. Crooker, S. Y. Del Valle, G. España, G. Fairchild, R. C. Gerkin, T. C. Germann, Q. Gu, X. Guan, L. Guo, G. R. Hart,
T. J. Hladish, N. Hupert, D. Janies, C. C. Kerr, D. J. Klein, E. Y. Klein, G. Lin, C. Manore, L. A. Meyers, J. E. Mittler, K. Mu, R. C. Núñez, R. J. Oidtman, R. Pasco, A. Pastore y Piontti, R. Paul, C. A. B. Pearson, D. R. Perdomo, T. A. Perkins, K. Pierce, A. N. Pillai,
R. C. Rael, K. Rosenfeld, C. W. Ross, J. A. Spencer, A. B. Stoltzfus, K. B. Toh, S. Vattikuti, A. Vespignani, L. Wang, L. J. White, P. Xu, Y. Yang, O. N. Yogurtcu, W. Zhang, Y. Zhao, D. Zou, M. J. Ferrari,
D. Pannell, M. J. Tildesley, J. Seifarth, E. Johnson, M. Biggerstaff, M. A. Johansson, R. B. Slayton, J. D. Levander, J. Stazer, J. Kerr, and M. C. Runge, Multiple models for outbreak decision support in
the face of uncertainty, Proceedings of the National
Academy of Sciences 120, 2017 (2023).
Kantner and Koprucki [2020]M. Kantner and T. Koprucki, Beyond just
“flattening the curve”: Optimal control of epidemics with purely
non-pharmaceutical interventions, Journal of Mathematics in Industry 10, 10.1186/s13362-020-00091-3 (2020), arXiv:2004.09471 .
Adhikari et al. [2020]R. Adhikari, A. Bolitho,
F. Caballero, M. E. Cates, J. Dolezal, T. Ekeh, J. Guioth, R. L. Jack,
J. Kappler, L. Kikuchi, H. Kobayashi, Y. I. Li, J. D. Peterson, P. Pietzonka, B. Remez, P. B. Rohrbach, R. Singh, and G. Turk, Inference, prediction and
optimization of non-pharmaceutical interventions using compartment models:
the PyRoss library, (2020), arXiv:2005.09625 .
Pietzonka et al. [2021]P. Pietzonka, E. Brorson,
W. Bankes, M. E. Cates, R. L. Jack, and R. Adhikari, Bayesian inference across multiple models suggests a strong
increase in lethality of COVID-19 in late 2020 in the UK, PLoS ONE 16, 1 (2021).
Li et al. [2021]Y. I. Li, G. Turk, P. B. Rohrbach, P. Pietzonka, J. Kappler, R. Singh, J. Dolezal, T. Ekeh, L. Kikuchi, J. D. Peterson, A. Bolitho,
H. Kobayashi, M. E. Cates, R. Adhikari, and R. L. Jack, Efficient Bayesian inference of fully stochastic epidemiological
models with applications to COVID-19, Royal Society Open Science 8, 211065 (2021).
Molina et al. [2022]J. J. Molina, S. K. Schnyder, M. S. Turner, and R. Yamamoto, Nash Neural Networks :
Inferring Utilities from Optimal Behaviour, (2022), arXiv:2203.13432 .
Harko et al. [2014]T. Harko, F. S. Lobo, and M. K. Mak, Exact analytical solutions of the
Susceptible-Infected-Recovered (SIR) epidemic model and of the SIR model with
equal death and birth rates, Applied Mathematics and Computation 236, 184 (2014), arXiv:1403.2160 .
Kröger and Schlickeiser [2020]M. Kröger and R. Schlickeiser, Analytical solution
of the SIR-model for the temporal evolution of epidemics. Part A:
time-independent reproduction factor, Journal of Physics A: Mathematical and Theoretical 53, 10.1088/1751-8121/abc65d (2020).
Reluga et al. [2006]T. C. Reluga, C. T. Bauch, and A. P. Galvani, Evolving public perceptions and
stability in vaccine uptake, Mathematical Biosciences 204, 185 (2006).
Tildesley et al. [2006]M. J. Tildesley, N. J. Savill, D. J. Shaw,
R. Deardon, S. P. Brooks, M. E. Woolhouse, B. T. Grenfell, and M. J. Keeling, Optimal reactive vaccination strategies for a
foot-and-mouth outbreak in the UK, Nature 440, 83 (2006).
Moore et al. [2021]S. Moore, E. M. Hill,
L. Dyson, M. J. Tildesley, and M. J. Keeling, Modelling optimal vaccination strategy for
SARS-CoV-2 in the UK, PLoS Computational Biology 17, 1 (2021).
Moore et al. [2022]S. Moore, E. M. Hill,
L. Dyson, M. J. Tildesley, and M. J. Keeling, Retrospectively modeling the effects of increased
global vaccine sharing on the COVID-19 pandemic, Nature Medicine 28, 2416 (2022).
Hill et al. [2022]E. M. Hill, N. S. Prosser,
E. Ferguson, J. Kaler, M. J. Green, M. J. Keeling, and M. J. Tildesley, Modelling livestock infectious disease control policy
under differing social perspectives on vaccination behaviour, PLOS Computational Biology 18, e1010235 (2022).
Keeling et al. [2023]M. J. Keeling, S. Moore,
B. S. Penman, and E. M. Hill, The impacts of SARS-CoV-2 vaccine dose separation
and targeting on the COVID-19 epidemic in England, Nature Communications 14, 1 (2023).
Kucharski et al. [2020]A. J. Kucharski, P. Klepac,
A. J. Conlan, S. M. Kissler, M. L. Tang, H. Fry, J. R. Gog, W. J. Edmunds, J. C. Emery, G. Medley, J. D. Munday,
T. W. Russell, Q. J. Leclerc, C. Diamond, S. R. Procter, A. Gimma, F. Y. Sun, H. P. Gibbs, A. Rosello,
K. van Zandvoort, S. Hué, S. R. Meakin, A. K. Deol, G. Knight, T. Jombart, A. M. Foss, N. I. Bosse, K. E. Atkins,
B. J. Quilty, R. Lowe, K. Prem, S. Flasche, C. A. Pearson, R. M. Houben, E. S. Nightingale, A. Endo, D. C. Tully, Y. Liu, J. Villabona-Arenas, K. O’Reilly, S. Funk,
R. M. Eggo, M. Jit, E. M. Rees, J. Hellewell, S. Clifford, C. I. Jarvis, S. Abbott, M. Auzenbergs, N. G. Davies, and D. Simons, Effectiveness of isolation, testing, contact tracing, and physical
distancing on reducing transmission of SARS-CoV-2 in different settings: a
mathematical modelling study, The Lancet Infectious Diseases 20, 1151 (2020).
Piguillem and Shi [2020]F. Piguillem and L. Shi, Optimal COVID-19
Quarantine and Testing Policies, EIEF Working Paper 20/04 (2020).
Schnyder et al. [2023b]S. K. Schnyder, J. J. Molina, R. Yamamoto, and M. S. Turner, Rational social distancing in
epidemics with uncertain vaccination timing, PLOS ONE 18, e0288963 (2023b), arXiv:2305.13618 .
Lenhart and Workman [2007]S. Lenhart and J. Workman, Optimal Control Applied
to Biological Models (Chapman and Hall/CRC, 2007).
Pontryagin et al. [1986]L. S. Pontryagin, V. Boltyanskii, R. V. Gamkrelidze, and E. F. Mishchenko, The Mathematical
Theory of Optimal Processes (Gordon and Breach
Science Publishers, 1986).