Other Statistics · Cross-listed from econ.GN
Housing Price Appreciation, Housing Affordability, and the Spatial Restructuring of Toronto Commuting
Shawn Berry
This study investigates the spatial relationships among housing-
market appreciation, housing affordability, and automobile commuting to Toronto across 23 census metropolitan areas and municipalities in southern Ontario from 2016 to 2021. Utilizing Statistics Canada Census data, the analysis employed linear and quadratic ordinary least-squares regression, Global and Local Moran's I, and residual spatial diagnostics to assess geographic patterns in average dwelling values, owner shelter-cost burden, and lone-driver commuting. The study found that average dwelling values increased significantly throughout the region, maintaining a strong nonlinear relationship with distance from Toronto, which indicates a persistent metropolitan accessibility gradient. Commuter volumes also demonstrated pronounced nonlinear distance gradients; however, housing appreciation was not significantly correlated with percentage changes in commuting ($R^2$ = .045, p = .331), suggesting that the expansion of the housing
market did not result in proportional growth in Toronto-bound automobile travel. The shelter-cost burden exhibited weaker distance relationships and greater residual spatial dependence, indicating localized affordability influences not fully explained by distance or dwelling values. Overall, the findings suggest an increasingly extensive regional housing
market with spatially heterogeneous affordability and commuting outcomes, highlighting the importance of integrating housing, transportation, and regional planning.
Read the full abstract ▾
Machine Learning (Statistics)
Robust conditional dimension reduction for dissimilarity data
Xiao Ling and Anh Bui
Conditional dimension reduction (cDR) learns low-dimensional latent coordinates while accounting for observed
covariates that represent known sources of variation in the data. Conditional Multidimensional Scaling (cMDS) is a cDR technique that works directly with dissimilarity data. Its standard squared-stress formulation, however, is sensitive to contaminated dissimilarity, since outliers can dominate the objective and distort the learned configuration. We proposed Robust Conditional Multidimensional Scaling (rcMDS) by replacing the squared-stress criterion with a Fair M-estimation objective. We developed a reweighted conditional SMACOF
algorithm to optimize this objective. The proposed
algorithm admits computationally tractable updates, and its stabilized objective values decrease monotonically and converge to a finite limit. Experiments on synthetic and real data show that the pro
Read the full abstract ▾
Statistics Theory · Cross-listed from quant-ph
Algorithmic Randomness and Physical Typicality
Jeffrey A. Barrett, Eddy Keming Chen and Josiah Lopez-Wild
Appeals to typicality are common in physics, but it is often unclear what it means for a physical state to be typical relative to a probability measure, and correspondingly unclear what a law that appeals to typicality asserts. Here we consider how one might characterize physical typicality using ideas from the theory of algorithmic randomness. As a concrete example, we show how taking a physical state to be typical relative to a computable measure when it is Martin-Löf random allows one to formulate the distribution postulate in Bohmian mechanics as a statistical constraining law of the theory. Using a toy model, we show how this constraint guarantees the standard Born statistics for computable experimental protocols. Algorithmic Bohmian mechanics (aBM) thus illustrates how algorithmic randomness may be used to provide precise content to a statistical law.
Read the full abstract ▾
Statistics Applications
From Discrete Trailing Returns to a Continuous Graphical Profile: Return-to-Present Curves
Lei Liu
Investment performance is commonly presented either as a conventional cumulative-return chart, which fixes a historical starting date and traces performance forward, or as a trailing-return table, which fixes the current endpoint but reports only a small set of prespecified horizons. These two displays have complementary limitations: fixed-start comparisons are conditional on the selected origin, whereas trailing returns provide only discrete snapshots of the underlying fixed-endpoint return function. We present the Return-to-Present (RTP) curve as a continuous fixed-endpoint representation that brings these perspectives together by holding the evaluation date fixed while allowing the hypothetical historical purchase date to vary over the available history. Familiar 1-month, 3-month, 6-month, 1-year, and longer trailing returns therefore become selected points on a continuous curve. When multiple investments are overlaid, RTP directly displays entry-date sensitivity, persistent relative advantage, crossings, and the timing and magnitude of separation without requiring selection of a single historical origin. The same endpoint-based construction naturally accommodates investments with unequal inception dates, recurring purchases, and retrospective portfolio rotation decisions in which sale and replacement-purchase dates may differ. We illustrate these uses with real investment data and discuss its relationship to momentum. RTP does not define a new return measure; its contribution is a simple graphical organization of familiar realized returns for historical comparison and decision support rather than prediction or statistical inference.
Read the full abstract ▾
Machine Learning (Statistics)
Recovering linear images of sparse signals from indirect observations
Anatoli Juditsky and Arkadi Nemirovski
In this paper, we develop and analyze techniques for recovering a linear image $Bx$ of an unknown signal $x$ from indirect noisy observation $\omega=Ax+\xi$. It is a priori known that $x\in \cX$, a given convex compact set, and that $x$ is $s$-sparse—has at most $s$ nonvanishing entries. The proposed estimates belong to a large family of recovery routines by $\ell_1$-minimization. However, unlike the classical result describing performance of such estimates, we do not make any special (and hard to check) assumptions about the sensing
matrix $A$ such as nullspace or Restricted Isometry condition and the like. As a consequence, parameters of the estimates and the upper bounds on their risks are not available in a closed analytic form, but are delivered instead by efficient computation as solutions to explicit convex optimization problems.
Read the full abstract ▾
Statistics Theory · Cross-listed from math.OC
Low-rank matrix recovery landscapes beyond RIP with application to rank-one measurements
Andrew D. McRae
We study the problem of low-rank
matrix recovery from linear measurements via the global nonconvex landscape of a low-rank factored formulation of the
matrix LASSO (nuclear-norm–regularized least-squares). If the landscape is benign, that is, has no bad local optima, then practical and scalable
algorithms can compute good statistical estimates. Previous state-of-the-art landscape guarantees have typically assumed that the linear measurement operator has the restricted isometry property, that is, the operator is approximately an isometry over all low-rank
matrices. This is an unrealistic assumption for many applications; in particular, when the individual measurement
matrices are themselves low-rank, we typically have poor upper isometry constants. To overcome this, we establish new guarantees of a benign landscape under a weaker isometry condition: rather than requiring upper isometry over all low-rank
matrices, we only require it over the linear low-rank tangent space to the low-rank ground truth
matrix. To illustrate the utility of this result, we apply it to the problem of
matrix recovery from random rank-one linear measurements; via high-probability concentration bounds on the random measurement operator, we prove a novel landscape guarantee with statistically near-optimal sample complexity and recovery error.
Read the full abstract ▾
Statistical Methodology
Causal DAG Identification for Count Data via Poisson Thinning Structural Equation Models
Penggang Gao, Ming Cai and Hisayuki Hara
Count-valued variables arise in many scientific and applied settings, yet explicit structural models that allow full identification of causal DAGs from observational data remain limited. The Poisson branching structural causal model (PB-SCM) provides a count-valued analogue of linear structural equation models using binomial thinning and independent Poisson exogenous variables, but its causal DAG is generally only partially identifiable. Building on this framework, we propose the Poisson thinning structural equation model (PT-SEM), which replaces binomial thinning in PB-SCM with Poisson thinning and allows node-wise exogenous distributions from diverse count-distribution families. Under node-wise regularity conditions, we establish identifiability of the causal DAG, the thinning coefficients, and the node-wise exogenous distributions. The same identification analysis extends to binomial thinning, yielding full identifiability whenever every nonsink has non-Poisson exogenous noise. We further develop a structure learning
algorithm that optimizes, via dynamic programming, a BIC score based on local likelihoods evaluated at plug-in moment estimates, and establish its consistency for DAG selection. Simulations demonstrate favorable performance in DAG recovery and thinning-coefficient estimation, and a real-data application illustrates the practical utility of PT-SEM.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from math.OC
The Role of Gradient Modification in Heavy-Tailed Nonconvex Stochastic Min-Max Optimization
Tianxi Zhu, Yi Xu and Xiangyang Ji
Stochastic min-max optimization has attracted increasing
attention due to its applications in modern machine learning, while existing theoretical studies mainly rely on the bounded variance assumption for
stochastic gradients. Under heavy-tailed noise, where
stochastic gradients only possess a finite $p$-th moment for $p\in(1,2]$, gradient clipping or normalization is commonly believed to be necessary to guarantee convergence. In this work, we revisit
stochastic min-max optimization under heavy-tailed noise and provide a comprehensive theoretical study of
stochastic gradient descent ascent (SGDA). We first show that vanilla SGDA, without any modification to its update rule, can converge under heavy-tailed noise in both nonconvex-strongly-concave (NC-SC) and nonconvex-concave (NC-C) settings, establishing the first convergence guarantees for SGDA in these regimes. Beyond unregularized problems, we further investigate regularized
stochastic min-max optimization, where directly incorporating gradient normalization into proximal updates is nontrivial due to the incompatibility between normalization and proximal structures. We overcome this difficulty by developing new clipping-free
algorithms, i.e., Stoc-TRGDAM and Stoc-TRGDmax, and they both can achieve the optimal dependence on the target accuracy without using gradient clipping.
Read the full abstract ▾
Statistics Applications · Cross-listed from cs.LG
Machine Learning for Pre-Culture ESBL Risk Stratification to Guide Empiric Antibiotic Selection: A 12-Hospital Study of Enterobacteriaceae Cultures
Aravind V. Kuruvikkattil, Lalitha Pranathi Pulavarthy, Rashmita Kudamala et al. (+1 more)
Empiric antibiotic therapy for suspected ESBL-producing Enterobacteriaceae must be selected 48-72 hours before culture results, forcing clinicians to choose between undertreating resistant infections and overusing carbapenems that drive further resistance. We developed a cost-sensitive XGBoost model predicting an ESBL phenotype (resistance to ceftriaxone, ceftazidime, cefepime or piperacillin-tazobactam) at culture ordering using 45 pre-culture EHR features across 132,955 cultures from 72,217 patients at 12 hospitals (14.41% with the ESBL phenotype). Cultures were partitioned at the patient level. At 90% sensitivity, the model achieved 95.8% NPV, reducing post-test ESBL probability to 4.2%, a threshold that may support safe carbapenem-sparing in non-ICU settings, while sparing 307 of every 1,000 cultures an unnecessary broad-spectrum course at the cost of 14 missed ESBL cases per 1,000. SHAP analysis identified prior ESBL colonization as the dominant predictor, ahead of prior organism burden and neighborhood deprivation; removing deprivation features caused minimal performance loss ($\Delta\text{AUROC} = -0.020$), enabling equitable bedside deployment. Discrimination was unchanged under a strict IDSA ESBL-E definition (AUROC 0.766), with specimen type added as a predictor (0.764) and without any class-imbalance correction (0.762), and ranged from 0.71 to 0.78 across organism strata.
Read the full abstract ▾
All authors Aravind V. Kuruvikkattil, Lalitha Pranathi Pulavarthy, Rashmita Kudamala, Saptarshi Purkayastha
Machine Learning (Statistics) · Cross-listed from cs.LG
On-the-go Forgetting without Explicit Unlearning via ERASE
Kushal Chakrabarti and Mayank Baranwal
Existing unlearning approaches typically rely on post hoc weight adaptation or
distillation, leading to duplicated
memory costs, degraded generalization, and limited scalability. In this work, we introduce ERASE, Erasure via Reconstructive
Adversarial Signal Editing, a framework for on-the-go forgetting that suppresses the observable influence of private data without modifying model weights. ERASE leverages structured, class-conditioned input perturbations to induce selective forgetting during inference, eliminating the need for retraining, fine-tuning, or model copies. We rigorously characterize sufficient conditions when ERASE provably achieves functional forgetting of designated subclasses while preserving predictions across other subclasses within the same superclass. This analysis offers a principled foundation for inference-time forgetting under mild regularity assumptions. Across diverse architectures and
benchmark datasets, ERASE maintains the best observed balance between forgetting efficacy, computational efficiency, and retention fidelity over recent unlearning-based methods. By reimagining data removal as forgetting without unlearning, our work establishes a scalable, regulation-aligned pathway for continual,
privacy-conscious learning.
Read the full abstract ▾
Statistics Applications · Cross-listed from cs.RO
Moment-Matching Probabilistic Data Association for Optimization-Based SLAM
Khoa Nguyen, Mitchell Turton and Florian Meyer
Optimization-based simultaneous localization and mapping (SLAM) makes it possible to reduce accumulated navigation errors of sensing platforms by returning to known areas (loop closure). In this paper, we present an approach to combine probabilistic data association (PDA) with optimization-based SLAM. Instead of associating a single measurement with each landmark, we follow the PDA paradigm from the multiobject tracking community. In particular, in a processing stage performed in addition to the nonlinear least-squares solver of optimization-based SLAM, our method (i) assigns multiple measurements to landmarks probabilistically, (ii) computes the mean and covariance of landmark distributions via moment matching by taking multiple measurement-to-landmark associations into account, and (iii) establishes a virtual landmark measurement and a corresponding linear-Gaussian measurement model that leads to the mean and covariance
matrix as moment-matching PDA in (ii). By converting the PDA update step into an equivalent linear-Gaussian measurement update step, PDA can be performed effectively within any optimization-based SLAM method. Our preliminary numerical evaluation in a scenario with false negatives and false positives indicates that incremental smoothing and mapping 2 (iSAM2), combined with the proposed PDA approach, can improve
agent localization performance compared to conventional iSAM2.
Read the full abstract ▾
Statistics Theory · Cross-listed from math.PR
A Gamma envelope and sharp moment inequalities for Gaussian quadratic forms
Zhekai Pang
We study extremal absolute central moments of Gaussian quadratic forms under a fixed Frobenius norm. For a nonzero real symmetric
matrix $M$ and $G\sim N(0,I_n)$, we construct an explicit centered difference of Gamma variables with the same mean, variance, and third centered moment as $G^{\mathsf T}MG-\operatorname{tr}M$. After normalization, replacing the quadratic form by this Gamma difference does not decrease $\mathbb{E} f$ for every $C^2$ test function $f$ such that $f''$ is convex and $f$, $f'$, and $f''$ have
polynomial growth. In particular, it gives an explicit upper bound for every absolute moment of order $p\ge3$. We then prove that, for every $p\ge4$, this bound is maximized by the centered square $g^2-1$ of a single standard Gaussian variable $g$. The resulting sharp inequality is \[ \bigl\|G^{\mathsf T}MG-\operatorname{tr}M\bigr\|_p \le \|g^2-1\|_p\,\|M\|_{\mathrm F}, \] with equality if and only if $M$ has rank one.
Read the full abstract ▾
Statistical Methodology · Cross-listed from econ.EM
Fixed-smoothing Uniform Inference for Quantile Regression
Kaicheng Chen, Antonio F. Galvao, Seunghwa Rho et al. (+2 more)
This paper develops fixed-smoothing (fixed-b, fixed-K) inference methods for time-series
quantile regression that are robust to heteroskedasticity and autocorrelation. Our approach is uniformly valid over
quantile levels and accounts for dependence both over time and across
quantiles. It enables the construction of uniform confidence bands, Wald, and Sup-t tests for joint hypotheses, and tests of shape restrictions, providing a unified framework for assessing heterogeneity in
quantile effects. A key challenge is that, under weak dependence, uniform inference for
quantile regression processes is generally non-pivotal because the limiting distributions depend on the long-run covariance structure across
quantiles. To address this issue, we develop two complementary approaches. The uniform-in-$\tau$ method estimates the covariance structure and simulates the non-pivotal limiting distribution. For certain tests involving a finite collection of
quantile levels, the stack-Wald method delivers pivotal fixed-smoothing inference. We establish the asymptotic validity of both approaches. Simulation results show that the proposed methods substantially improve size control relative to existing HAC-based procedures while maintaining good power. An application to predictive
quantile regressions for stock returns reveals substantial heterogeneity in predictive effects across both
quantiles and forecast horizons.
Read the full abstract ▾
All authors Kaicheng Chen, Antonio F. Galvao, Seunghwa Rho, Timothy J. Vogelsang, Jungmo Yoon
Machine Learning (Statistics) · Cross-listed from cs.LG
Selective Posterior Margin Regularization for Forward-Corrected Classification
Zexing Zhang, Jichao Li, Tianyang Lei et al. (+2 more)
Learning with class-conditional label noise often relies on a transition model from latent clean classes to observed annotations. Forward correction embeds this transition in the likelihood, yet finite-sample networks may still memorize corrupted labels. The corrected likelihood also induces a reverse posterior over the clean classes that could explain each annotation. When its leading class differs from the annotation, the model and transition
matrix provide evidence against that annotation, but the leading alternatives can remain nearly tied. We introduce Selective Posterior Margin Regularization (SPMR), which preserves the Forward objective and converts this disagreement into a graded update on the clean classifier. SPMR selects the leading reverse-posterior class, scales a detached pairwise margin by the separation between the two leading posterior classes, and assigns correspondingly little influence to diffuse conflicts. The gap factorizes into transition- adjusted pairwise separation and the posterior mass carried by the leading pair. The active margin follows the locally minimum-norm logit direction that enlarges the selected pairwise margin. Across five known-transition
benchmarks, SPMR improves full-length Forward by 2.5-7.0 percentage points and remains 0.7-2.5 percentage points above Forward with Mixup and early stopping. Matched interventions support distinct gains from the posterior-space coefficient, transition-adjusted target, and pairwise action. The same design transfers to estimated transitions, human annotations, architectural changes, and stronger Forward recipes. The formulation uses latent-class evidence already available inside Forward correction without promoting every posterior conflict to a corrected label.
Read the full abstract ▾
All authors Zexing Zhang, Jichao Li, Tianyang Lei, XiongYi Lu, Yang Kewei
Statistics Theory
A spectral gap for Metropolis-adjusted Langevin algorithm with a uniformly randomized step size
Qian Qin
Let $\pi(\mathrm{d} x)\propto e^{-U(x)}\, \mathrm{d} x$ on $\mathbb{R}^d$, where $U$ is continuously differentiable and $m$-strongly convex with a globally $L$-Lipschitz gradient, $0<m\leq L<\infty$, and $\kappa=L/m$. Fixed-step Metropolis-adjusted Langevin
algorithm (MALA) has known warm-start mixing-time upper bounds of order $\kappa\sqrt d$, up to logarithmic factors. A spectral-gap lower bound at the corresponding scale $(\kappa \sqrt{d})^{-1}$ would give an upper bound of order $\kappa \sqrt{d}$ on the Monte Carlo asymptotic variance relative to independent sampling, uniformly over all square-integrable functions. However, when $\kappa$ is bounded away from~1, the best fixed-step spectral gap that can be guaranteed uniformly over this target class is at most of order $\max\{\log(\kappa d)/(\kappa d), e^{-cd}\}$ for some positive universal constant~$c$. We show that uniform randomization of the step size improves this worst-case guarantee. At each iteration, the
algorithm draws $h\sim\operatorname{Unif}(0,H)$ and performs one ordinary MALA transition. Choosing $H$ of order $[L\sqrt{d(1+\log d+\log\kappa)}]^{-1}$ yields a right spectral-gap lower bound of order \[ \frac{1}{\kappa\sqrt{d(1+\log d+\log\kappa)}}, \] uniformly over the target class. Thus, given $\kappa > 1$, for all square-integrable functions, the ratio of the Monte Carlo asymptotic variance relative to independence sampling has an upper bound of order $\sqrt{d \log d}$. This contrasts with fixed-MALA, where the ratio can be as bad as $d/\log d$ in thew worst-case scenario. The spectral gap also gives
geometric convergence of the lazy kernel from every initial density in $L^2(\pi)$, central limit
theorems, and nonstationary mean-square error bounds. This work was developed with substantial assistance from ChatGPT.
Read the full abstract ▾