Papers

Pairwise randomization can yield substantial efficiency gains in experiments. Yet methodological guidance cautions against pairwise randomization, especially in settings with attrition, partly because common practices for estimation (i.e., pair fixed effects) imply discarding data from incomplete pairs thus exacerbating data loss from attrition. This practice of dropping incomplete pairs reduces statistical power of tests as well as precision of estimates, in paired experiments, compared to designs with less finely stratified treatment assignment. We argue that this concern is misplaced if attrition is independent of treatment status and potential outcomes, and that these issues follow from an inefficient use of the data that remains post-attrition. First, we show how, by using a specific permutation test, it is possible to use all observed units for inference (complete pairs and incomplete pairs where one unit attrits) while still exploiting the pairwise randomization design structure. The test procedure we suggest provides exact size control under the sharp null. Second, we study an optimally weighted estimator that efficiently combines within-pair and across-pair comparisons. Finally, we show that combining these two insights yields a test procedure that dominates the two commonly used inference methods (a paired $t$-test and the two-sample $t$-test) in power, for any level of attrition. Usefully for applied researchers, we show that the efficient procedure can be implemented via a weighted fixed effects regression, straightforward in standard software. In sum, our results provide researchers with practical tools for conducting experiments with pairwise randomization without sacrificing observations or statistical power when facing independent attrition.

Adaptive therapy has emerged as a promising treatment strategy that exploits within-tumour competition to delay disease progression. Implementation, however, typically relies on indirect measurements of tumour burden and must account for potentially substantial patient heterogeneity. In this work, we capture patient-to-patient variability, parameter uncertainty, and imperfect biomarker measurements with a mathematical and statistical model that we calibrate to clinical prostate cancer data using a Bayesian inference framework. We use the resulting virtual cohort to demonstrate that, within the simple but now well-established Lotka-Volterra-based model, adaptive therapy robustly improves time-to-progression for the subset of patients that are predicted to eventually progress by the model. To account for other risk factors associated with larger tumour volumes, we introduce a new metric based on the risk of metastasis that demonstrates how adaptive therapy may be disadvantageous when sustained tumour burden is also considered. Given the ubiquity of uncertainty in oncology, we then describe several future modelling directions that also capture uncertainty in the temporal evolution of the underlying tumour or biomarker dynamics. Finally, we demonstrate how model misspecification and non-identifiability can lead to unreliable predictions, especially if uncertainty is inadequately captured.

When experienced mayors govern better-performing municipalities, it is tempting to credit the leader. Yet municipalities with stronger administrative capacity may also be more likely to attract and elect experienced mayors, generating selection on pre-existing municipal capacity. We examine this identification problem using a balanced panel of 1,642 Peruvian district municipalities from 2015 to 2022. Within-municipality estimators and panel double machine learning recover a positive association between prior public-management experience and investment-budget execution, while formal education is substantially weaker. Negative-outcome controls reveal an important distinction. Across municipalities, mayoral human capital predicts GDP and HDI measured before the mayor took office, providing evidence of selection in cross-sectional comparisons. By contrast, the first-difference negative control aligned with the within-municipality design shows that changes in mayoral experience do not predict pre-determined district GDP, while they remain associated with budget execution. Sensitivity analysis and partial-identification bounds nevertheless do not support a clean causal interpretation of that within association. The results therefore separate two sources of variation often conflated in studies of political leadership and show how negative-outcome controls can sharpen the identification of leader effects.

Three features of the global warming process are of central scientific interest: its level, its warming rate, and changes in that warming rate. We develop a semiparametric kinematic state-space framework for estimating the latent kinematic path of global warming from noisy monthly temperature observations. The framework estimates the warming level, warming rate, and warming acceleration jointly, while incorporating covariates, serial dependence, and time-varying error variance directly in the model. Applying the framework to five major global temperature records, and comparing it with nonparametric kernel and parametric benchmark estimators, we show that the inferred recent warming dynamics depend strongly on the object being estimated. The current underlying warming level is estimated precisely and is robust across datasets and methods, with estimates close to \(1.4\,^{\circ}\mathrm{C}\) above pre-industrial levels. Estimates of the current warming rate are consistently positive and elevated, but differ materially across estimator classes: flexible local estimators imply substantially higher current rates than long-window parametric specifications, which instead summarize average post-break or restricted-curvature behaviour. Our preferred state-space specification estimates the current warming rate at approximately \(0.47\,^{\circ}\mathrm{C}\) per decade. Evidence on acceleration is necessarily more uncertain, because acceleration is a local second derivative. Nevertheless, the estimated kinematic paths show positive acceleration in the recent period, and the endpoint acceleration estimates are positive across datasets and methods.

I develop a reproducible framework for evaluating individual batting and bowling performances in Twenty20 (T20) cricket on one interpretable scale of runs above expectation, built from two ball-level primitives. The first, Runs Above Expected (RAE), is the residual between the runs scored on a delivery and a contextual expectation of what an average performer would produce in the same situation. That expectation is a multiplicative log-linear model of the cohort scoring rate, whose per-cell estimator is shown to be a conditional Poisson maximum likelihood multiplier. It is fitted by iterated backfitting and stabilised by empirical Bayes shrinkage, so that thinly sampled contexts are pooled towards the population. A single opposition symmetry places run-scoring and run-prevention on the same footing. The second primitive, Dismissal Adjusted Runs (DAR), prices a dismissal in that currency as the runs it forgoes, read off a batting side value function solved by dynamic programming through a Bellman expectation recursion, under observed play. Because dismissal is the expected end of every innings, the realised wicket cost (realDAR) is centered against its expectation (xDAR) under a league dismissal hazard rate. The centered quantity is a run-weighted mean zero martingale residual of the dismissal process, so a player is charged only for departing from average behaviour. The two primitives sum to a symmetric Impact, which makes batting and bowling comparable in centre as well as in unit. Estimated on over 2.7 million legal deliveries of men's T20 cricket, the framework recovers known contextual structure, agrees with the conventional rates it refines while correcting their context-blindness, and yields face-valid player, innings and season leaderboards for the Indian Premier League.

Urban rail transit reliability is a critical measure of system performance, yet its causal determinants remain poorly quantified due to high-dimensional and interdependent influencing factors. This study investigates reliability patterns across 46 international metro operators between 1994 and 2024 using the CoMET benchmarking database, incorporating more than 90 candidate variables spanning technical, operational, financial, environmental, and macroeconomic conditions. Based on domain knowledge, literature synthesis, and variable construction, four operational determinants are designed to capture three mechanisms: demand pressure, service supply, and demand-supply imbalance, while the remaining variables are screened and incorporated as confounders where theoretically appropriate. Double/Debiased Machine Learning (DML) adapted for panel data is introduced to urban rail reliability analysis to quantify the net causal effects of these determinants under complex and nonlinear relationships. The framework combines flexible machine learning with panel fixed or random effects within-operator temporal variation, reducing bias from high-dimensional confounding, model misspecification, and unobserved operator heterogeneity. The results identify three distinct operational mechanisms. Higher passenger demand intensity increases incident rates by 0.38% (p<0.001). On the supply side, greater fleet supply adequacy and car-based operational intensity reduce incident rates by 0.52% (p<0.05) and 0.80% (p<0.01), respectively. Capacity utilization, which reflects the imbalance between demand and available supply, increases incident rates by 0.49% (p<0.001). These findings show that metro reliability depends not only on the level of demand or supply alone, but also on whether service provision keeps pace with passenger demand.

Compositional predictors, such as microbiome abundances, pose unique challenges in variable selection due to their unit-sum constraint and inherent dependencies. Existing approaches often rely on fixed association graphs derived from phylogenetic or ecological distances, which may not reflect outcome-relevant relationships. We propose GRACE (GRaph-Adaptive horseshoe for Compositional rEgression), a fully Bayesian framework that enforces compositional constraints, performs variable selection, and adaptively learns an outcome-driven shrinkage graph. GRACE achieves compositionality through a novel linear reparameterization of regression coefficients, while a structured horseshoe prior induces sparsity and smooths coefficients along the learned graph. Graph learning is accomplished via scaled beta2 priors on edge weights, providing both outcome-specific adaptation and posterior uncertainty quantification. We develop an efficient Gibbs sampler incorporating elliptical slice sampling to ensure scalability in high dimensions. Through extensive simulations, GRACE demonstrates competitive predictive accuracy and improved graph recovery compared with existing methods, particularly under graph misspecification. Application to oral microbiome data from the ORIGINS study identifies taxa associated with insulin resistance and yields an outcome-driven graph summarizing how those taxa relate to the outcome, a structure that differs substantially from phylogenetic or co-occurrence networks. These findings highlight that fixed predictor graphs useful for regularization may not faithfully represent outcome-relevant feature relationships, underscoring the need for adaptive, outcome-informed approaches in compositional regression.

In high-dimensional online prediction, sparse comparators motivate regret bounds that depend on sparsity rather than ambient dimension. Feature priming seeks such adaptation by reweighting features using past data and refitting a minimum-norm predictor. At COLT 2023, Warmuth and Amid posed the open problem of whether the univariate, Pearson, or multivariate priming rules admit competitive online regret guarantees. Under the natural past-only Moore–Penrose protocol, we establish sparse-regret lower bounds that refute the corresponding sparse-logarithmic guarantee. The key obstruction is cheap nuisance interpolation, which permits exact interpolation of the history while assigning insufficient weight to the truly predictive coordinate. An exact target-mass identity and a two-sign argument convert this obstruction into clipped prediction loss. Hadamard constructions yield $\Omega(\min\{T,\sqrt d\})$ clipped regret for each of the three unit-power rules against a zero-loss one-sparse comparator. For every fixed power $\alpha\ge1$, one shared paired construction further yields linear regret simultaneously for all three powered rules and selectors among them in sufficiently high dimension. A rank upper bound is tight for powered univariate priming, even with Euclidean-unit inputs, and for unit-power Pearson priming with coordinatewise bounded inputs and target-preserving totalization. A separate algebraic construction gives $\Omega(\min\{T,d^{1/4}\})$ regret for unit-power multivariate priming under Euclidean-unit inputs. The univariate lower bound persists under any nonnegative second-stage ridge schedule, while a paired ridge construction yields linear lower bounds for all three powered rules. Exploratory diagnostics on frozen language-model activations are consistent with the same qualitative mechanism. The exact multivariate frontier remains open.

In large-scale epidemiological studies, it is often of interest to investigate joint relationships between longitudinal and time-to-event outcomes with exposures that are trajectories or functions. Our motivation study is the Objective Physical Activity and Cardiovascular Health (OPACH) Study, which collected accelerometry-measured physical activity in 6,489 older women. One of the scientific aims is to understand sedentary behavior accumulation patterns and its association with physical function (longitudinal) and mortality (time-to-event). We propose a novel approach that first converts raw accelerometry data into daily sitting bout accumulation profiles, which are treated as functional covariates, and then develop a functional joint model for longitudinal and time-to-event outcomes that incorporates a baseline functional covariate. The longitudinal process is modeled using functional data methods and linked to the survival process through functional principal component scores. Both sub-models include interpretable linear scalar-on-function regression coefficients to capture flexible dose-response associations between sitting accumulated across varying bout durations and health outcomes. Estimation is carried out via an efficient expectation-maximization (EM) algorithm with penalized spline approximations. Simulation studies demonstrate accurate parameter estimation and reliable model selection. Application to the OPACH data reveals flexible and interpretable dose-response relationships between sitting bout durations, physical function, and mortality.

Customer decline early-warning systems feed account-manager action lists, and every flagged account consumes intervention capacity. In a deployed business-to-business marketplace system, one action-list slot in three went to flags that dissolve under a seasonally aligned label. The standard target in non-contractual churn prediction compares an entity's next k months of activity with its trailing k months. The two windows cover different calendar months, so for seasonal entities the threshold-ratio construction confounds seasonality with decline, and the event rate depends on the label's anchor calendar month. We formalize the mechanism and measure it on three public panels and the production panel (the public arms pre-specified). Of the adjacent-window decay events, 37–69% on the public panels and 28–50% in production have no counterpart under a seasonally aligned definition. Pooling anchors, the standard remedy, balances the training mixture but corrects no individual label. Measured alternatives repair the curve only partially or change the detection horizon. Aligning the baseline to the same k calendar months one year prior – advice practitioners already state, here formalized, measured, and costed – flattens the curve at the source. With the classifier held fixed, production holdout ROC-AUC rises from 0.767 to 0.864 for decline (different targets; the gap closes on synthetic ground truth and a production hindsight referee). The served action list shrinks by a third, 119 to 79 accounts. The measured price is extra history, a blind spot to decline-then-stabilization, and a stricter cut under sustained growth.

Electoral reforms – including changes to district boundaries, electoral rules, and the size of elected bodies – are a recurrent feature of American state and municipal politics. The representational impact of such reforms is challenging to assess before they are implemented, and even well-intentioned civic reformers are often surprised by the unintended consequences of changes to the political system. We develop a statistical framework for the prospective evaluation of electoral reforms by integrating several modes of analysis: descriptive statistics of the voter file, probabilistic race and ethnicity imputation, ecological inference, and redistricting simulations via ensembles. Together, these tools provide a unified assessment of how proposed reforms affect whose voices are ultimately heard in government. We apply this framework to reforms currently being considered for the Los Angeles City Council, including increasing the number of single-member districts, adopting ranked-choice voting, and introducing multimember districts elected by proportional ranked choice voting. We find that expanding the Council alone is unlikely to substantially improve representation for underrepresented communities. In contrast, eliminating low-turnout primary elections and adopting multimember districts produce larger improvements in representational equity. Our analyses were shared with L.A.'s Charter Reform Commission via public testimony in late 2025. Although motivated by Los Angeles, the framework is broadly applicable to evaluating prospective electoral reforms across American jurisdictions.

Learning analytics often treats unsupervised clusters of intelligent tutoring system (ITS) logs as learner types that should predict learning. We test that assumption on EdNet-KT3. Clustering study-strategy features (resource use, revision, video, problem practice) for 5{,}000 active learners yields a silhouette-selected parent cut ($k=5$) with 4 contrast poles (reading-focused, video-heavy, revision-heavy, and problem-first) plus a large near-mean residual ($\sim$64.9%). Reclustering that residual adds four finer styles, giving a bootstrap-stable hierarchy of 8 named strategies. We split each learner's timeline by respond count so clusters use only the early half and outcomes only the late half. Early clusters predict later engagement (continuing to practice and finishing late sessions, especially persistence, $\eta^{2}\approx 0.106$; completion $\eta^{2}\approx 0.021$) but not later unassisted accuracy (correctness on late first-attempts without help; $p_{\mathrm{adj}}\approx 0.093$). Volume rises with some styles, yet volume-only clustering barely matches strategy labels (ARI$=0.064$). A knowledge-tracing model (SAKT) on the seven TOEIC exam sections predicts next correctness only modestly better than a baseline that knows only how hard each section usually is (AUC lift $+0.051$; CI $[+0.045,+0.058]$), and that mastery signal is nearly independent of behavior styles (ARI$=0.007$). Behavioral clustering here describes study styles and engagement, not knowledge gains.

Electrophysiological brain signals are typically acquired through indirect and noisy measurements, providing transformed representations of the underlying neural activity. Source reconstruction—the inverse problem of resolving underlying neural signals from these measurements—is essential for mapping brain function but remains challenging because it is ill-posed and sensitive to noise. Deep learning methods have shown promise across a range of inverse problems, yet many do not explicitly incorporate the biophysical principles governing data generation, limiting data efficiency and adaptation across subjects. Here, we introduce DeepOp-Informed, a biophysics-informed geometric deep operator learning framework that embeds the biophysics of the sensing process into the model through a custom differentiable layer, enabling more efficient learning and improved reconstruction performance. This layer enables the neural network to adapt to subject-specific variations in the physics of signal generation, resulting from differences in brain anatomy and sensor positioning. In realistic magnetoencephalography simulations, DeepOp-Informed generalizes to forward models from held-out subjects, reducing reconstruction error relative to several neural-network and classical baselines. Applied to adolescent auditory-evoked recordings, it produces anatomically plausible reconstructions localized to the auditory cortex. While our application focuses on magnetoencephalography, the framework is general and may be adaptable to other imaging modalities.

In survival analysis the way covariates act on the risk of an event often differs between early and late failure times, yet hazard- and mean-based summaries collapse this variation into a single number. Quantile-based modeling instead describes the full conditional distribution on the original time scale, but existing censored-data methods are either inflexible or produce logically inconsistent crossing quantile curves. We propose a Censored Non-crossing Quantile (CNQ) framework for right-censored data that jointly estimates several conditional survival quantiles and guarantees valid ordering by construction, with flexibility supplied by Kolmogorov-Arnold and Transformer backbones, and we establish a finite-sample excess-risk bound holding jointly across all fitted quantile levels. Across 27 simulation settings and six cohorts the framework attains lower pinball loss than quantile-, hazard- and tree-based competitors whenever the conditional distribution is asymmetric, with interval coverage closer to nominal on all six. In two clinical case studies (METABRIC, breast cancer; FLCHAIN, population mortality) it recovers covariate effects that vary across the survival distribution and would be hidden by a single hazard ratio, and yields coherent individualized quantile milestones. Code: https://github.com/BIG-S2/deepcnq

Bayesian dynamic borrowing (BDB) methods leverage historical data to reduce treatment effect uncertainty, yet existing approaches rely on parametric outcome models susceptible to misspecification. We propose the nonparametric latent exchangeability prior (NP-LEAP), an outcome-agnostic, assumption-lean framework to borrow information from historical data. The NP-LEAP performs individual-level exchangeability assessment, inducing Bayesian model averaging over all possible partitions of the historical data into exchangeable and nonexchangeable subsets. Although applicable to a variety of data types with choice of appropriate kernel, the NP-LEAP is particularly well-suited for studies with time-to-event outcomes, where parametric BDB is potentially triply misspecified - imposing a parametric baseline hazard, the proportional hazards structure, and blanket exchangeability. We establish posterior consistency under mild regularity conditions. Simulation studies demonstrate favorable operating characteristics relative to parametric borrowing methods and nonborrowing semiparametric frequentist methods. We illustrate the method by augmenting the control arm in a randomized trial of patients with non-small cell lung cancer.

Seasonal infectious-disease interventions are commonly evaluated with interrupted time-series or pre–post designs that align epidemics by calendar week. When epidemic onset, speed or peak timing differs between seasons, such comparisons confound a shift in epidemic phase with a change in disease burden. We propose a Bayesian causal count model in which season-specific affine transformations map calendar time to a latent epidemic clock, and intervention effects are estimated on that clock rather than on the calendar. The alignment is a model component rather than a preprocessing step, so uncertainty about epidemic timing propagates into every causal contrast. The model uses a negative-binomial observation distribution, hierarchical area, season and area-season effects, a shrunk Fourier epidemic curve, and a continuous programme-intensity exposure. Posterior g-computation yields prevented cases, prevented fractions, peak attenuation and epidemic displacement, under both a controlled contrast and a dynamic contrast that propagates disease history within each arm. A two-tier simulation study evaluates bias, root mean squared error, interval coverage and parameter recovery under stable timing, epidemic-clock variation, intensity-dependent ascertainment and area-level confounding. We illustrate the framework using open Catalan primary-care surveillance and respiratory syncytial virus immunisation data, with explicit attention to the overlap in programme intensity that identifies the effect.

Dataset alignment is a central step in data analysis across science and engineering, where the goal is to match observations between datasets. Entropic Optimal Transport (EOT) offers a computationally tractable framework for this task by encoding cross-dataset affinities in a transport plan. However, when two datasets are sampled from geometrically similar low-dimensional structures with substantially different sampling densities, the EOT plan may match points by relative sampling density rather than geometric proximity, yielding geometrically misleading correspondences. To address this issue, we propose a density-reweighted EOT framework in which the influence of sampling density on the transport plan can be discounted to a desired degree, ranging from standard EOT to alignment driven purely by underlying geometry. Under suitable regularity conditions, we establish convergence of the reweighted EOT plan to a family of population-level plans whose dependence on sampling density is made explicit. Through simulations, we show that our approach recovers geometrically faithful correspondences, improving over related EOT-based frameworks when datasets exhibit substantial sampling density disparity.

Problem-solving log process data from computer-based assessments provide detailed information about how respondents approach and complete tasks. However, the resulting action sequences are complex and noisy, making it difficult to identify specific behaviors associated with successful performance. This paper proposes a representation-learning item response modeling (IRT) framework for identifying behaviorally important actions while accounting for respondent proficiency and item-level differences. Raw log sequences and timing information are first transformed into action representations that incorporate the hierarchical structure of action labels and the sequential and temporal context in which each action occurs. These respondent-specific representations are then entered as covariates in an extended IRT model, with spike-and-slab priors used to identify action-item combinations associated with response accuracy. The framework therefore evaluates actions contextually rather than as simple occurrence indicators and provides posterior uncertainty for their associations with performance. We apply the approach to problem-solving process data from the OECD Programme for the International Assessment of Adult Competencies (PIAAC). The analysis identifies a sparse set of actions associated with successful and unsuccessful performance and reveals differences across items in where behavioral information occurs within the problem-solving process.

LLM judges are often evaluated with a single prompt and only a few repeated calls. When their verdicts vary, it remains unclear whether the variation comes from sampling noise within a prompt or systematic differences across prompts. We formalize this distinction using a second-order response law: the distribution of prompt-conditioned verdict distributions induced by a declared prompt policy. For a quadratic measure of prompt instability, we show that the usual plug-in estimator is biased upward at finite repeat budgets because it confounds within-prompt noise with between-prompt variation. We derive unbiased estimators for both sampled prompts and declared fixed prompt censuses from the difference between within- and across-prompt agreement. Under a crossed prompt-by-answer-order design, the same framework separates prompt, order, interaction, and residual call variation, while retaining invalid completed outputs as outcomes. Known-law simulations and a byte-identical live null recover the predicted finite-$R$ inflation. In a matched Qwen study, corrected low-repeat estimates are closer to an independently acquired $R=16$ reference than plug-in estimates, with the largest gains at small repeat budgets. A matched panel across four frozen judge configurations exhibits configuration-specific inflation magnitudes and component profiles. Prompt robustness can therefore be estimated separately from finite-call noise.

Estimating high dimensional Generalized Structural Equation Models presents severe computational challenges. Traditional simultaneous estimators frequently suffer from numerical instability and prohibitive computational costs. Moreover, there are no tractable algorithms for families such as Poisson, negative binomial, and gamma. To overcome these limitations, this article introduces a Two Stage Quasi-Likelihood Expectation-Maximization framework. The proposed method isolates the structural model from the measurement model. First, it approximates the conditional distribution of the latent variables given the observed indicators. Second, it employs marginal quasi-likelihood estimating equations to evaluate the structural parameters, deriving the necessary conditional moments either exactly or through Monte Carlo integration. This approach completely avoids the need to evaluate the full joint likelihood. Extensive simulations demonstrate that our method drastically reduces computational runtime, providing a numerically stable framework that minimizes the mean squared error and structural bias to yield a scalable and flexible solution for analyzing complex latent variable models.

Air-quality and climate monitoring routinely convert native-resolution measurements into exceedance counts before testing whether high values cluster in time. A surrogate null can be imposed on the derived index or on the native series and then propagated through the same thresholding and aggregation. We show that the two placements can encode different scientific hypotheses and lead to opposite conclusions. In 31 Chilean PM2.5 monitoring stations (2018–2025), weekly clustering of days above the 50 ug m^-3 national 24-hour standard was significant at all stations under an index-level IAAFT null but at only two under a daily native-resolution null; a native generative null with seasonal marginals and short-memory Gaussian-copula dependence agreed with the native surrogate at 30 of 31 stations. Across thresholds spanning the WHO guideline (15 ug m^-3) to the Chilean episode-alert level (80 ug m^-3), index-only rejections increased from 8 of 31 to all eligible stations as monthly event probabilities became more seasonally concentrated, and equalizing monthly event probabilities at the 50 ug m^-3 level reduced index-only decisions from 29 to five. We formalize the issue as null transport through a lossy observation map: an exact aggregate-level equivalent of a native null exists if and only if the randomization kernel is lumpable with respect to that map. A within-fiber diagnostic, which perturbs native amplitudes while keeping the observed index exactly fixed, shows that this condition fails in the monitoring data: the native null distribution moved by a median of 18 times its Monte Carlo variability. Weekly clustering of PM2.5 exceedances in Chile is therefore fully compatible with seasonality plus short-memory daily persistence, and index-level surrogate rejections should not be read as evidence about daily concentration dynamics.

In transfer-learning settings, a model derived from abundant surrogate labels may be deployed in a target population where gold-standard outcomes are unobserved. Evaluating its target performance is essential for determining whether decisions based on the model remain reliable, yet it is difficult when gold labels are scarce, and covariate distributions differ across data sources. We study a three-sample setting with a small gold-labeled source, a larger surrogate-labeled source, and an unlabeled target. Under conditional transportability, we evaluate the surrogate-derived model against the latent gold-standard outcome in the target population. We propose cross-fitted estimators that transport information from the two labeled sources through source-specific density ratios. We also combine outcome-regression augmentation with a kernel correction for estimating the model near a threshold, accounting for uncertainty from all three samples. We establish asymptotically linear inference for TPR and FPR, consistency and pointwise inference for the ROC curve, and asymptotically normal inference for AUC. Simulations assess bias, coverage, and sensitivity to bandwidth and relative sample sizes. A retrospective temporal validation on Chatbot Arena and a semi-synthetic ACS-Income study provide validation in real-world AI applications.

Understanding whether a digital marketing campaign is effective is central to designing effective customer engagement strategies. We analyze a large-scale, longitudinal promotional email campaign conducted by a U.S.\ retailer to evaluate how value-added incentives, such as free shipping, compare with traditional price discounts in influencing customer purchasing behavior. The analysis is complicated by non-compliance, due to not opening emails, multiple longitudinal mediators, and zero-inflated mediators and purchase outcomes. To address these challenges, we develop a Bayesian causal mediation framework based on enriched Dirichlet process mixture models and estimate the causal estimands using a scalable G-computation algorithm. We show that analyses ignoring email-opening behavior substantially attenuate estimated effects. Value-added incentives consistently outperform price discounts, yielding higher estimated potential purchase amounts, with benefits accumulating over time. We design an individualized sequential emailing strategy that optimizes expected purchase count in the observed data.

Clinical studies generally assume that group-level averages are useful quantities for guiding individual-level decisions in the clinical care of each individual patient. Precision medicine has notably closed the gap towards truly individualized care through highly refined subgrouping. Today, digital health technologies and other modern sources of dense, personal "small data" enable a different approach to treatment individualization—one that seeks to characterize a single person's own recurring health patterns first and foremost, rather than identifying the best subgroup to which they might belong. In this chapter, we review the key concepts underlying n-of-1 studies, single-case designs, and other "multitudinal" approaches for digital health applications, and explore their relationships to other digital health methods. We also share some promising future directions for "esametry", the statistics of the digitized multitudes within each of us.

In the face of spatial interference, researchers are often interested in estimating treatment effects at specific points located in space. Wang et al. (2025) and Pollmann (2023) provide design-based frameworks for estimating spillover effects on points located across a range of distances from interventions. Although these frameworks are design-based, we show their proposed estimands rely on outcomes that are directly unobservable and therefore, require outcome modeling. When using modeled outcomes in practice, even the typically design-unbiased Horvitz-Thompson estimator can accrue bias as a result of the modeling error. The performance of spatial outcome models depends on the density or resolution of observed outcomes. Through simulation, we find that the bias of the estimators decays with increasing outcome density, but not with increasing numbers of intervention units, and standard errors using modeled outcomes converge to the oracle standard errors. To demonstrate the role of outcome modeling with spatial interference, we reanalyze an experiment from Collazos et al. (2021) on the effect of hot spots policing on crime and provide several suggestions for practice.

Large household surveys support precise national estimates but can become statistically fragile after repeated disaggregation by geography, sector, sex, age, and outcome category. This paper develops an auditable design-based framework for deciding how far such disaggregation can be taken in a stratified multistage survey. The framework is built around a nested contribution ledger that reconstructs each domain total through the first stage probability proportional to size expansion, the certainty-plus-random hamlet-group selection, and the second-stage household expansion. Nonlinear domain parameters are expressed as ratios of these totals and analyzed by first-order linearization. The two independent National Sample Survey subsamples then provide a natural replication variance estimator. A granularity-stability profile combines the resulting relative standard error with replicate support and concentration diagnostics, so that a detailed estimate is accompanied by evidence about whether the design can sustain it. Finite population unbiasedness of the total estimator, asymptotic validity of the ratio linearization, and unbiasedness of the two-subsample variance estimator for linearized totals are established. The method is illustrated with the 71st-round Social Consumption: Education survey, focusing on home language versus medium of instruction and reported reasons for preferring private educational institutions in India and Himachal Pradesh. The application preserves the substantive analysis in the original project while replacing ad hoc calculation with a reproducible inferential workflow.

Recent works in econometrics have shown that there can be issues with applying a constant treatment effect model in longitudinal settings with staggered treatment and heterogeneous treatment effects. We focus on the issue that the estimated constant treatment effect may be a weighted average, with some negative weights, of treatment effects that are heterogeneous across treatment durations. When this issue arises, the estimated constant treatment effect and estimated heterogeneous treatment effects may result in conflicting results. Through the example of estimating the effect of drug-induced homicide (DIH) prosecutions reported by media on unintentional drug-overdose deaths in the United States, we illustrate how the negative weighting issue can lead to conflicting results in practice. Moreover, although research has shown that the negative weight issue may arise in linear regression models, we show this issue may also arise in logistic regression models. Using a linear link, we estimated a constant treatment effect risk ratio of 0.977 (95% CI:(0.866, 1.101)) and an average risk ratio of 0.728 (range: 0.507-0.979) over different treatment durations. Using a logistic link, we estimated a constant treatment risk ratio effect of 1.064 (95% CI: (0.972, 1.165)) and an average risk ratio of 0.739 (range: 0.538-1.008) over different treatment durations. Under both models, the estimated constant treatment effect is either smaller in magnitude or has a different sign than almost all estimated heterogeneous treatment effects, suggesting a negative weighting issue is present. Our results suggest additional care is needed when applying constant treatment effect models in longitudinal settings.

Thinned count autoregressions are popular for modelling infectious disease surveillance data due to their flexibility and interpretability. However, such a model is challenging to fit since it involves high-dimensional and serially correlated integer-valued unknowns. One solution is to consider an analogous continuous-valued surrogate model whose values are post-hoc mapped to integers. This procedure produces biased estimates as inference is performed using samples from such a surrogate model and not the thinned count autoregression itself. In this work, we propose a sequential importance sampling procedure to correct this misspecified model. We demonstrate its validity in a simulation study and its applicability for epidemic curve reconstruction using rotavirus data from Germany and meningococcus data from France.

Ensuring food security across all regions of a country requires continuous monitoring, yet household surveys often leave significant spatio-temporal gaps due to resource constraints and operational priorities. In this paper, we propose a spatio-temporal additive Gaussian process model to estimate sub-national food security time series by regions. To address the computational cost of Gaussian process models, we exploit Kronecker structure of the spatio-temporal covariance matrix for scalable inference. We evaluate the proposed approach on food security survey data from Nigeria and Chad comparing it against other statistical and machine learning models and show how our proposal achieves better accuracy while retaining reliable uncertainty, especially when covariates are informative. We further apply the model to generate estimates for Nigerian states not covered by the survey, demonstrating its operational value for filling geographic gaps in food security monitoring.

Regional wet-bulb temperature means omit the spatial distribution of humid heat. We compare upper-quartile and middle-half days of the monthly regional mean at 121 sites in a specified eastern-China domain. A prespecified multiscale architecture combines Gaussian-weighted semivariances at five bandwidths with equal-month, equal-scale and equal-summer aggregation. The specification was developed on the 2015 and 2022 summers and applied unchanged to 33 other summers in 1991-2025. On high-mean days, the weighted mean squared pairwise WBT contrast was 7.28% lower. This corresponds to a 3.71% reduction after square-root transformation and a 3.97% mean reduction in record-level root-mean-square pairwise differences. Contraction strengthened as the Gaussian graph bandwidth increased, from 2.86% at h = 126 km to 13.27% at h = 2,013 km. Exact Laplacian decompositions localised the broad-scale contrast to daily anomalies opposing the monthly north-south climatological pattern, while anomaly energy changed little. The pattern persisted in 1950-1990. A sparse external station comparison showed concordant broad-scale direction. High regional humid heat was associated with a flatter broad geographic field, a feature that a regional mean cannot identify.