Probability · Cross-listed from math.CT
Sample-Smooth Spaces: A Convenient Category for Differentiable Probabilistic Programming
Patrick Forré
We introduce the category $\mathbf{SSS}$ of sample-smooth spaces over a mixed site. The test objects are the products $\Omega_n := \mathbb{R}^n \times \Omega$ of a Cartesian space with the universal
Hilbert cube $\Omega$ carrying all universally measurable sets, and a space is a set with a family of admissible plots $\Omega_n \to \mathcal{X}$ closed under precomposition. Smoothness and measurability are then not two structures glued along an axiom, but one structure over one site. The site has finite non-empty products, because $\Omega$ absorbs its own square; its Karoubi envelope contains every $\mathbb{R}^n$; and it has mixed morphisms $\omega \mapsto (W(\omega),\Phi(\omega))$, which turn measurability of a smooth family from an axiom into a consequence. $\mathbf{SSS}$ is a concrete quasitopos: complete, cocomplete, cartesian closed and locally cartesian closed, with a classifier for
embeddings. Morphisms of Cartesian spaces are exactly the $C^\infty$ maps and
manifolds embed full and faithfully, both without Boman's
theorem. Every object has tangent and cotangent spaces, every morphism a differential. The modalities sit in an adjoint string $\Pi \dashv \flat \dashv \natural \dashv \sharp \dashv \Lambda$, making $\mathbf{SSS}$ cohesive over quasi-universal spaces. The point is the probability monad. Defining the plots of $\mathsf{P}(\mathcal{X})$ as push-forwards of $\mathcal{X}$-plots at every test object, $\mathsf{P}$ is an unconditional strong commutative affine monad on all of $\mathbf{SSS}$ – functor, unit, product of kernels, multiplication and the monad laws are each one line of seed splitting – and its Kleisli category, of differentiable simulators, is a Markov category. The reparametrisation trick holds by construction: every Kleisli morphism is plot-wise a sampler, stably under composition. A reflection
theorem locates the whole gain in a single plot family.
Read the full abstract ▾
Probability · Cross-listed from cs.LG
Criticality in Dissimilar Decomposition and Undersampling of Random Datasets with Anomalies
Ghurumuruhan Ganesan
Training
datasets for upcoming LLMs would include a significant amount of AI text/image data generated from current LLMs. In such a scenario, it is important to understand how this affects batch decompositions and thereby, the performance of the resultant new LLM. In this paper, we consider AI generated data as anomalies “linked" to main data points and study decomposition and undersampling properties of the overall random
dataset. We use redundancy graphs and iteration techniques to obtain bounds for the minimum size of a strongly dissimilar (SD) decomposition and demonstrate a phase transition phenomena, wherein the minimum size is essentially determined by the main data points when the number of anomalies is small and is “taken" over by the anomalies above a certain threshold. We also establish a size criticality result for the strong similarity of a randomly undersampled
dataset and illustrate our results with examples involving categorical
datasets, whose overall space size is much larger than the size of the
dataset.
Read the full abstract ▾
Probability
A diffusion model for time-dependent compositional data
Lu Chen, Omar De la Cruz Cabrera and Oana Mocioalca
We introduce a
stochastic process for modeling the
evolution in time of compositional measurements (i.e., a vector of non-negative values that add up to a total of 1). This model is a
diffusion, as it is defined as the solution for a
stochastic differential equation in the Ito sense, and it has a Dirichlet distribution as its steady distribution. We have named this process Dirichlet
Diffusion (DD). As the process is confined to a
manifold and the coefficients of the equation are not globally Lipschitz, the usual
theorems do not apply directly and establishing the existence and properties of solutions requires a somewhat delicate analysis. We establish the existence of strong solutions under the assumption that all the parameters of the Dirichlet distribution are greater than 2; for the general case we were only able to establish the existence of weak solutions, but also that these solutions remain confined to the closed simplex without need for reflecting boundaries. A useful feature of DD that it inherits from the Dirichlet distribution is the property of aggregation: If components are combined to create a coarser composition, the resulting process is also a DD. This makes it useful, for example, for jointly modeling the
evolution of a microbiome grouping the microbe species at different taxonomic levels.
Read the full abstract ▾
Probability · Cross-listed from math.MG
Mean distance between points inside and on the boundary of a convex body
A. S. Lotnikov
The Zaporozhets–Tarasov
conjecture is considered, which states that the mean distance between two random points inside a convex body does not exceed the mean distance between two random points on its boundary. For centrally symmetric bodies the question is settled completely: the
conjecture is proved for planar bodies and disproved in every dimension at least three, for all moments of the distance; an explicit family of counterexamples is constructed together with a dimension-lifting construction. It is also shown that for sufficiently high moments an analogous inequality holds for any planar convex body. For circumscribed bodies exact relations between the mean distances are obtained — analogues of Kingman's formula derived via the projective distributions introduced here; moreover, the
conjecture is proved for triangles in a stronger per-projection form.
Read the full abstract ▾
Probability · Cross-listed from math.MG
The Zaporozhets-Tarasov Inequality for an Arbitrary Planar Convex Body
Maksim Kukushkin
We prove that the mean distance between two independent uniformly distributed points in an arbitrary planar convex body is strictly smaller than the mean distance between two independent uniformly distributed points on its boundary. Equality is impossible, although the difference between these two mean distances tends to zero along a sequence of thin rectangles. The proof reduces the problem to a one-dimensional comparison of two Gini mean differences. The main new ingredient is a moment lemma for a random pair $(\varepsilon,R)\in\{-1,1\}\times[0,1]$. The only finite algebraic part of the proof is given by exact rational certificates in the Bernstein basis; the verification script and all 6492 coefficients are available in the supplementary materials.
Read the full abstract ▾
Probability
Dynamical Gibbs-non-Gibbs transitions for finite-alphabet models on trees
Sebastian Bergmann, Christof Külske and Niklas Schubert
We study finite-alphabet
spin models on trees evolving under independent symmetric
spin-flip dynamics. On the
lattice the time-evolved plus measure of the low temperature Ising model in zero external field was shown to be non-quasilocal for all sufficiently large times in \cite{EnFeHoRe02}. On the tree however the time-evolved plus phase of the Ising model behaves differently, as the quasilocal Gibbs property is first lost, but then recovered at a later time \cite{EnErIaKu12}. We first extend this result by showing that large-time reentry into the quasilocal Gibbs regime on the tree happens more generally for all finite alphabet models, when the dynamics is started in $f$-stable Gibbs states. These are defined in terms of a time-independent sharp condition on the homogeneous recursion $f$ describing the model, which can be checked explicitly. As our second and opposite result, we develop a method for proving large-time persistence of non-quasilocality of time-evolved measures. We show that even all configurations can become bad at large times, when the initial Gibbs measure corresponds to an $f$-saddle and give an explicit illustration for the Potts model. In our proofs we study the influence of spatially inhomogeneous perturbations to the solutions of a time-dependent fixed point problem.
Read the full abstract ▾
Probability
Gradient Gibbs measures with non-convex potentials and the universality class of the Gaussian Free Field
Simon Buchholz, Codina Cotar and Florian Schweiger
We study a general class of gradient interface models with
Hamiltonian $H=\beta\sum V(\nabla\phi)$, $\beta>0$, assuming essentially that the potential $V$ is even, $V'(s)\ge \alpha s$ on $[0,\infty)$ for some $\alpha>0$, and $-M\leq V''\le C$. We establish a Helffer-Sjöstrand representation for these models, and use it to prove that their scaling limits are Gaussian Free Fields (GFFs), and that their covariances decay at the same rate as the GFF. This extends results for strictly convex potentials to a large class of non-convex potentials and to arbitrary temperatures. Additionally, we prove Brascamp-Lieb and dimension-free Poincaré inequalities for the models. We obtain these results by representing the interface as a mixture of gradient interface models with strictly convex potentials, extending an idea by Biskup-Spohn who had considered mixtures of Gaussians at moderate inverse temperature $\beta=1$. The construction of such a representation is one of the key new contributions of this work.
Read the full abstract ▾
Probability · Cross-listed from math.DG
The Fisher Metric of the Ricci Flow Heat Kernel
Bennett Chow and Robert Koirala
We introduce and study a Fisher information metric \(g^F_\tau\) associated to the conjugate heat kernel of a Ricci flow \((M^n,g_t)\). This tensor measures, at a fixed scale, how the pointed heat-kernel measure changes when the base point is moved. We prove that \(g^F_\tau\) is monotone in scale and satisfies \(g^F_\tau\le g_t\). We relate its trace to the pointed Nash
entropy and prove a
matrix square identity for the Fisher defect \(g_t-g^F_\tau.\) This identity gives a rigidity
theorem for the equality case; on closed connected flows one has the strict inequalities \(0<g^F_\tau<g_t\) at every positive scale, while in the complete case equality forces a Euclidean splitting. We also develop several consequences of this point of view. These include a sharp reverse Poincaré inequality for the heat semigroup, a contraction formula for \(\varphi\)-divergences along conjugate heat flow, and a canonical construction of heat-kernel splitting maps from large
eigenvalues of the Fisher endomorphism. As applications, we relate pointed Nash
entropy close to \(0\) to small Fisher deficit at comparable scales, and we obtain a codimension-one Fisher-metric criterion for applying Bamler's \(\varepsilon\)-regularity
theorem.
Read the full abstract ▾
Probability
Correlated Gaussian Moments Determine Polynomials up to Orthogonal Equivalence
Obayda Julien Assaad
Let $P$ be a real
polynomial of degree at most $m$ on $\mathbb{R}^d$. We construct finitely many correlated Gaussian moments that determine $P$ up to an orthogonal change of variables. The number of copies and the rational covariance
matrices are specified in terms of $d,m$. On coefficient balls, the induced map on orthogonal orbits has a Hölder continuous inverse with an explicit exponent. For $m\geq3$, the normalised local stationary-phase expansion at the critical branch through the origin equals the Gaussian moment series. Its coefficients recover the same finite moment vector, without assumptions on the other critical points. If the leading homogeneous part has an isolated complex critical point, we compute the twisted de Rham ranks and construct formal
lattices on each fixed coupling support.
Read the full abstract ▾
Probability · Cross-listed from math.ST
Converse bounds for multiple graph alignment and correlation detection based on last matching
Taha Ameen and Bruce Hajek
The paper focuses on information theoretic converse bounds for the
alignment of $m$ correlated graphs and for the detection of correlation among $m$ graphs. A simple idea for $m\geq 3$ is that if the
alignment of $m-1$ of the graphs is revealed as extra information (by a genie for example) then it is still necessary to produce the
alignment between the one remaining graph and the others, i.e. the last matching must be accomplished. For both Gaussian and Erdos-Renyi models, the last-matching problem is equivalent to one with two observed graphs, providing a path to extend converse bounds for $m=2$ to larger $m$. While the method is rather obvious for
alignment, we show that the method can also be used to derive converse bounds for weak detection of correlation.
Read the full abstract ▾
Probability
Non-Shattering at and Above the Dynamical Temperature in the Spherical Pure p-Spin Model
Taegyun Kim
We consider the notion of shattering introduced by Ben Arous and Jagannath for spherical pure $p$-
spin glasses with overlap $q$. For every $p\geq 3$ and $0<\beta\leq\beta_{\mathrm{sh}}(p)$, we rule out shattering whenever $q\leq2^{-1/2}$ or $q>\sqrt{(p-2)/(p-1)}$. The proof combines a deterministic $N+1$ bound for disjoint bands in the first range with a general-$p$ sign law showing that their total marked weight has subdominant free energy in the second. A spherical-code bound and Hölder's inequality give an additional $q$-dependent obstruction; in particular, they rule out every fixed overlap for $0<\beta\leq\sqrt{\log2}$. For $p=3$, the first two ranges already exhaust every fixed $q\in(0,1)$, so the landscape is not shattered at any $T\geq T_{\mathrm{sh}}$. For $p\geq4$, the cases not covered by our criteria are confined to $2^{-1/2}<q\leq\sqrt{(p-2)/(p-1)}$ and $\sqrt{\log2}<\beta\leq\beta_{\mathrm{sh}}(p)$. In particular, this paper partially resolves
Conjecture 1 of the paper above and also suggests new methods to show non-shattering.
Read the full abstract ▾
Probability · Cross-listed from math.FA
A Deterministic Proof of the Slicing Theorem
Silouanos Brazitikos
We give a deterministic proof of Bourgain's slicing
theorem. The proof uses neither
stochastic localization nor
stochastic calculus, does not rely on Guan's covariance bound, and avoids $M$-ellipsoids, Pisier's regularization machinery, and complex interpolation. Instead, the argument is based on a deterministic one-parameter quadratic perturbation of the measure, a covariance-survival principle, and a
geometric analysis of $L_p$-centroid bodies.
Read the full abstract ▾
Probability · Cross-listed from math.AP
Analytic inverse problems with finitely many random measurements
Giovanni S. Alberti, Damiano Poletti, Simone Sanna et al. (+1 more)
While infinite-dimensional inverse problems are traditionally analyzed assuming continuous data, practical applications rely on finitely many discrete measurements. Recent deterministic approaches establish that unknowns belonging to a $d$-dimensional model class can be stably recovered from finitely many measurements. However, for severely ill-posed problems, such as the Calderón problem and inverse scattering, the known constructions may require a number of measurements that is exponential in $d$. We show that random sampling reduces this count dramatically if one asks only for exact identifiability. By exploiting the analytic geometry of the forward maps, we prove that, whenever the infinite-data problem is injective on the model class, $2d+1$ random scalar measurements determine the unknown uniquely, almost surely. Applications are given to the Calderón problem, with both infinite- and finite-dimensional boundary sampling, and to inverse medium scattering from randomly sampled far-field values.
Read the full abstract ▾
All authors Giovanni S. Alberti, Damiano Poletti, Simone Sanna, Matteo Santacesaria
Probability · Cross-listed from math.DG
Camillo Brena and Elia Bruè
We study Ollivier–Ricci
curvature on Cayley graphs of groups of
polynomial growth. Our main result shows that non-negative Ollivier–Ricci
curvature forces the group to be virtually abelian. As an application, we prove that connected vertex-transitive graphs of
polynomial growth and non-negative Ollivier–Ricci
curvature are quasi-isometric to $\mathbb{Z}^k$, for some $k\in\mathbb{N}$.
Read the full abstract ▾
Probability
Exact moduli of continuity for the local times of Feller Brownian motions
P.J. Fitzsimmons and Jay Rosen
We examine the modulus of continuity, in the spatial variable, of the local time process of Feller Brownian motion (FBM) on the half-line $[0,\infty)$. Briefly, a FBM is a strong Markov process on $[0,\infty)$ that moves like standard Brownian motion on $[0,\infty)$ up until it first encounters the state $0$. The process returns to $(0,\infty)$, either continuously (like reflecting Brownian motion) or by jumping to a (random) positive state chosen according to a specified measure. The present work is a continuation and application of our earlier work with Michael Marcus on the moduli of continuity for the local times of a Markov process built by piecing together (“rebirthing") the paths of another Markov process with finite lifetime. We first establish a general result on the resolvent and local times for a rebirthed process with a special holding state (the state $0$ for FBM). We show how our earlier approach using the Eisenbaum Isomorphism
Theorem on an assemblage of excursions works out in this context. This knowledge is then used as an approximation device to obtain our main result on the exact uniform moduli of continuity for the local time of FBM on a spatial interval of the form $(0,1]$. Extensions are made, under certain conditions, to the more delicate situation of the spatial interval $[0,1]$. We also consider briefly the case of more general
diffusions on $[0,\infty)$.
Read the full abstract ▾
Probability
Max-semistable extremal behavior of AR(1)-processes connected with Bernoulli convolutions
Peter Kern and Alef Sterk
We consider simple autoregressive processes of type AR(1), whose stationary distribution is supported on a subset of the unit interval and is an affine transformation of a Bernoulli convolution. A new structural representation of the stationary distribution as a product of a power function with a log-periodic function near the origin is given, which gives structural insight to the stationary distribution on the whole unit interval by using a characteristic functional equation. This enables to prove that the stationary distribution of the AR(1)-process belongs to the domain of
geometric partial attraction of a max-semistable law. We further prove uniform convergence of the distribution function of normalized maxima of the AR(1)-process to a certain power of the max-semistable law in the spirit of a merge
theorem and point out connections to deterministic and random dynamical systems.
Read the full abstract ▾
Probability
Mod-phi convergence for random variables with cyclotomic generating functions
Christoph Thäle and Philipp Tuchel
We consider a sequence of discrete random variables whose generating functions are
polynomials only having roots on the unit circle in the complex plane. For such sequences we prove, under mild assumptions, mod-$\phi$ convergence with explicit rate and limiting function. This allows us to recover, in a unified way, classical central limit
theorems as well as finer asymptotic expansions. The general theory is applied to random permutations and random partitions.
Read the full abstract ▾
Probability
Energy decomposition by potential level
Nicolas Bouleau
In the first part we study excessive functions for a Markov process that are continuous semimartingales along the sample paths. The property then follows from the theory of local times of semimartingales. We next treat the case of Dirichlet spaces and show that, if u is a quasi-continuous version of a function u belonging to a regular Dirichlet space, then the image under u of the local energy measure of u is absolutely continuous with respect to Lebesgue measure. Finally, in a third part, we establish the occupation-time density property for certain Dirichlet processes.
Read the full abstract ▾
Probability
Boundary Harnack principle for diffusion with jumps on metric measure spaces
Zhen-Qing Chen and Jie-Ming Wang
A non-scale invariant BHP on any open set is obtained for a large class of discontinuous Hunt processes on metric measure spaces that are in weak duality with another Hunt process under suitable conditions in terms of estimates of exit distributions from open sets, and bounds on Green functions and the comparability of the jump density function. These conditions are easy to verify in concrete cases. Several examples are given to illustrate the main results and the new contributions of this paper. Our result in particular establishes the BHP on any open set for any Hunt process associated with a regular symmetric Dirichlet form on a metric measure space having both the strongly local term and the pure-jump term that admits a two-sided heat kernel estimates of the mixture of (sub-)Gaussian and stable-like form, as well as for a wide class of non-symmetric
diffusion processes with jumps on $\mathbb R^d.$
Read the full abstract ▾