Numerical Analysis · Cross-listed from physics.geo-ph
Acceleration methods for the planar 3D ILSA hydraulic fracturing model
V. I. Shukalo, A. V. Valov and A. N. Baykin
Planar 3D models of hydraulic fracturing provide a practical balance between models with restrictive
geometric assumptions and fully 3D simulators, capturing fractures with arbitrary planar footprints at moderate computational cost. Nevertheless, applications such as treatment design optimization and mini-frac test interpretation require large ensembles of simulations, for which the cost of planar 3D models remains a significant bottleneck. This work presents acceleration strategies for the planar 3D Implicit Level Set
Algorithm (ILSA) to reduce simulation runtime while preserving numerical accuracy. A unified planar 3D ILSA scheme that consolidates the nested loops of the elastohydrodynamic solver and the front tracking
algorithm into a single iterative process is introduced. A
matrix splitting approach is applied to the linearized elastohydrodynamic system, moving the dense part of the elasticity operator to the right-hand side and yielding a sparse system
matrix that can be solved more efficiently. Anderson acceleration is incorporated into the solution of the elastohydrodynamic system to improve convergence. A predictor–corrector scheme is additionally examined in combination with these methods. Each technique is evaluated individually and in combination on both the reference and unified schemes across five
benchmark cases. Numerical experiments demonstrate that the unified scheme alone delivers an average 2.3x speed-up, reaching 3.8x for the Sandglass case. The combined application of all techniques achieves an average 4.2x speed-up and up to 14.4x for the Sandglass case. The schemes are also assessed during fracture closure, where the
matrix splitting and Anderson acceleration prove most effective, together reaching up to 3.4x.
Read the full abstract ▾
Optimization and Control · Cross-listed from stat.ML
Set Membership Estimation for Stochastic Linear Contextual Bandits
Haonan Xu and Yingying Li
Contextual bandit learning has attracted increasing
attention in engineering applications due to its ability to incorporate side/context information in time-varying environments. A widely used approach for contextual bandits is optimism in the face of uncertainty (OFU), in which uncertainty sets for unknown parameters are constructed and decisions are made optimistically over these sets. In the bandit literature, uncertainty sets are typically derived using statistical learning tools, such as confidence intervals. In contrast, set membership estimation (SME), a well-established uncertainty quantification approach in control and system identification, has received little
attention in the bandit literature. This paper investigates the connection between SME and contextual bandits by focusing on linear contextual bandits as a starting point. We propose an SME-based OFU
algorithm and establish a sublinear regret bound under proper assumptions. Simulations further demonstrate the promising performance of SME-OFU compared with existing methods. This supplementary manuscript provides more proof details in Section IV and the Appendix.
Read the full abstract ▾
Mathematical Physics · Cross-listed from astro-ph.SR
Once more: Leaky MHD waves in coronal magnetic flux tubes
Hans Goedbloed and Rony Keppens
By a detailed comparison of leaky magnetohydrodynamic waves in coronal
magnetic flux tubes with leaky electromagnetic waves in dielectric media it is shown that the latter kind may be called quasi-normal modes, since they can be regularised by a normalisation which systematically cuts off the contribution of the external homogeneous region, whereas such a possibility is forbidden for the former kind by the conservation of
magnetic flux. Consequently, leaky magnetohydrodynamic waves cannot be systematically applied to coronal seismology, i.e. to the inverse spectral problem of determining the different
equilibrium distributions of the fields by comparing the spectra they produce with the observed ones.
Read the full abstract ▾
Algebraic Geometry
A simple proof for Hochster's Theorem
Stefan Schröer
We give a conceptual proof for Hochster's
Theorem, which asserts that each spectral space is homeomorphic to the spectrum of a ring. Given a ground field and a spectral space, our ring is constructed as filtered direct limit of
prime-finite ring, which are attached in a functorial way to finite Kolmogoroff spaces. The construction simplifies an argument of Ershov along these lines. Our crucial ingredient is an assembly of finite Kolmogoroff spaces in terms of coequalizers and pushouts of one-dimensional spaces, and Schwede's observation on
prime ideals in cartesian squares of rings.
Read the full abstract ▾
Optimization and Control
A Regularized Nikaido-Isoda Function Approach to Multi-Leader-Follower Games
Atsushi Hori, Takayuki Okuno and Ellen H. Fukuda
A multi-leader–follower game (MLFG) is a hierarchical noncooperative game in which leaders compete at the upper level while taking into account the followers' best responses at the lower level. A typical approach to solving the MLFG reformulates it as an
equilibrium problem with
equilibrium constraints (EPECs) by replacing the lower-level game with its KKT conditions. Another approach, when each follower's response is unique, is to reformulate the MLFG as a Nash
equilibrium problem by substituting these response functions into each leader's problem. However, both reformulations may lack scalability since higher-order derivatives may be required when solving the resulting problems. In this paper, we propose a new reformulation of the MLFG by exploiting a regularized Nikaido–Isoda function and approximating the MLFG by a single-level differentiable Nash
equilibrium problem with a penalty parameter. The proposed reformulation neither requires derivative information on the followers' game nor assumes convexity of each follower's problem; hence, it can handle a broader class of MLFGs. Under global subanalyticity, we analyze the mathematical relationship between
equilibria of the original MLFG and the proposed reformulation.
Read the full abstract ▾
Mathematical Physics
Dirac structures on tangent bundles: a geometric framework for variational principles, constrained dynamics, and symmetry reduction
Hiroaki Yoshimura
We introduce a Dirac structure on the tangent bundle of a configuration
manifold, called a Lagrange–Dirac structure, which is naturally induced by the Lagrangian two-form associated with a (possibly degenerate) Lagrangian and a constraint distribution. This structure provides a unified
geometric framework for Lagrange–Dirac dynamical systems, encompassing nonholonomic, degenerate Lagrangian, and symmetric systems. In the hyperregular case, the system recovers a first-order formulation of the Lagrange–d'Alembert equations. Although nonholonomic dynamics does not preserve the Lagrangian two-form, we show that the underlying Lagrange–Dirac structure is preserved up to gauge transformations, yielding a natural gauge covariance property. We also formulate an intrinsic variational principle directly on the tangent bundle, referred to as the Lagrange–d'Alembert–Dirac principle, which recovers Hamilton's principle in the unconstrained case and the Lagrange–d'Alembert principle in the hyperregular constrained case. Furthermore, we develop a reduction theory for systems with Lie group
symmetry, deriving a reduced Lagrange–Dirac structure over the Lie
algebra that yields the Euler–Poincaré–Dirac equations and a corresponding reduced variational principle. Finally, we illustrate the theory through examples including charged particles, electric
circuits, and systems with Lagrangians linear in velocity, and present an infinite-dimensional extension to ideal fluids that naturally incorporates the incompressibility constraint and recovers the Euler equations.
Read the full abstract ▾
Rings and Algebras
Product of two matrices similar to companion matrices over sufficiently large fields
Flavien Mabilat
In this note, we prove that a square
matrix of size $n$ over a field containing at least $2n$ elements can be expressed as the product of two
matrices similar to companion
matrices, that is to say
matrices with the same minimal and characteristic
polynomial, if and only if the rank of $A$ is greater than $n-2$, using only classical facts. We will also give some partial results valid over smaller fields.
Read the full abstract ▾
Mathematical Physics · Cross-listed from quant-ph
Optimal Shadow Estimation with Minimal Measurement Settings
Zhiyao Yang, Datong Chen and Huangjun Zhu
Shadow estimation is a powerful framework for predicting
quantum properties from randomized measurements. While $3$-design protocols achieve optimal worst-case performance, the minimal number of measurement bases required for such optimality has remained open. Here we prove that $\Theta(d^2)$ measurement bases are both necessary and sufficient for worst-case optimal shadow estimation and construct an explicit basis family. In stark contrast, any state $2$-design already suffices for average-case optimality: the mean squared shadow norm of normalized observables is bounded by a universal constant, and we prove strong concentration for Haar-random states, yielding constant sample complexity for generic pure-state fidelity estimation. Easily implementable $2$-designs – from mutually unbiased bases, cyclic measurements, or shallow $\mathcal{O}(\log n)$-depth
circuits – enable optimal average-case protocols with remarkably simple measurement strategies. Our results establish a fundamental complexity separation: worst-case estimation requires $\Theta(d^2)$ bases, whereas average-case performance requires only $\Theta(d)$ bases, with broad implications for
quantum information theory and near-term experiments.
Read the full abstract ▾
Algebraic Geometry
Calculating Archimedean Height Pairing via generalized cross-ratio
Alexander B. Goncharov
During the last several years, Spencer Bloch emphasized that Archimedean hight pairings between two homologically trivial cycles of complimentary arithmetic dimensions, or the closely related classes in the biextension, should lead to interesting analogs of the classical cross ratio. In this note I calculate such a generalized cross-ratio for planes in the projective space.
Read the full abstract ▾
Quantum Algebra
Two examples of combinatorial relations among relations of $C_{n}\sp{(1)}$-standard modules for higher levels
Tomislav Šikić
The construction of relations among relations is one ingredient in the Groebner-like basis construction of the maximal ideal of the universal vertex operator
algebra $V^k_{\mathfrak g}$ for affine Lie
algebras. For affine Lie
algebras of type $C_n^{(1)}$, such combinatorially parametrized relations among relations were constructed in earlier work for level $2$ standard modules \cite{PS3}, and for $C_2^{(1)}$-standard modules at higher levels \cite{S}. This article presents two further examples in which the same counting method can be carried out. The first treats $C_n^{(1)}$-standard modules at the fixed level $k=5$, with $n$ arbitrary. The second treats $C_3^{(1)}$-standard modules for arbitrary level $k$. In both cases the calculation compares the number of required relations among relations in a trapezoid of the array of negative root vectors with the corresponding representation-theoretic dimension.
Read the full abstract ▾
Metric Geometry
Polynomial valuations on plane polygons
Askold Khovanskii, Valentina Kiritchenko and Vladlen Timorin
Scissors congruence problems involving translations have prompted the study of translation invariant simple valuations. We review this classical theory from a naive and consistent viewpoint: starting from a description of all simple valuations on polygons, we characterize the effect of translation invariance. A description of all
polynomial simple valuations is obtained as a bi-product of the adopted approach and as a direct generalization of the translation invariant theory; it appears to be new.
Read the full abstract ▾
Combinatorics
Co-edge-regular graphs with four eigenvalues and unbounded coherent rank
Edwin R. van Dam, Hong-Jun Ge and Jack H. Koolen
In the regular three-
eigenvalue setting, spectral complexity and coherent-algebraic complexity coincide: a connected regular graph has exactly three distinct
eigenvalues if and only if it is strongly regular, its coherent rank is three. Although examples of regular graphs with four distinct
eigenvalues and coherent rank larger than four are known, it was unknown whether coherent rank is uniformly bounded among regular graphs with four distinct
eigenvalues. We show that no such bound exists, even under the additional assumption of co-edge-regularity. For every
prime power \(q\), we construct infinitely many co-edge-regular graphs with exactly four distinct
eigenvalues, smallest
eigenvalue \(-2q-1\), and coherent rank at least \(q+4\). Consequently, coherent rank is unbounded among co-edge-regular graphs with exactly four distinct
eigenvalues.
Read the full abstract ▾
Rings and Algebras
Explicit descriptions of the subfields $(NL)^{pi}$ and $(NL)^{pi}(NL)^{sep}$ of $NL$ and new explicit criteria for $NL = (NL)^{pi}(NL)^{sep}$
V. V. Bavula
Let $L=K(\theta)\simeq K[x]/f(x)$ be a simple field extension in
prime characteristic $p>0$, $L^{sep}$ and $L^{pi}$ be the maximal separable and purely inseparable subfields of $L$, respectively. Let $N/K$ be a purely inseparable field extension. For the field extensions $L/K$ and $NL/N$, the aim of the paper is to give explicit descriptions of the following subfields and their degrees in terms of the coefficients of the
polynomial $f$ and two numerical field invariants $m_f$ and $m_{f,N}$: $L^{pi}$, $L^{pi}L^{sep}$, $(NL)^{pi}$ and $(NL)^{pi}(NL)^{sep}$. From these results, we derive new explicit criteria for $L=L^{pi}L^{sep}$ and $NL=(NL)^{pi}(NL)^{sep}$.
Read the full abstract ▾
Number Theory
Symmetric square $L$-functions on $\mathrm{GL}_3$
Johannes Linn
We give an asymptotic formula with a power-saving error term for the twisted first moment of symmetric square $L$-functions on $\mathrm{GL}_3$ in the spectral aspect. We apply this to obtain non-vanishing results and lower bounds of the expected order of magnitude for even moments, supporting the random
matrix model for a
unitary ensemble of $L$-functions. The main ingredients are the $\mathrm{GL}_3$ Kuznetsov formula, an asymmetric approximate functional equation, and strong bounds for the integral transforms appearing in the Kuznetsov formula.
Read the full abstract ▾
Rings and Algebras
Nijenhuis Lie $2$-algebras
Apurba Das
In this paper, we first introduce Nijenhuis Lie 2-
algebras as the categorification of Nijenhuis Lie
algebras. We prove that the category of Nijenhuis Lie 2-
algebras is equivalent to the category of 2-term Nijenhuis $L_\infty$-
algebras. Next, given a Nijenhuis Lie
algebra, we introduce the notion of a 2-representation and show that the corresponding semidirect product inherits a Nijenhuis Lie 2-
algebra structure. On the other hand, we consider a $2$-term representation up to homotopy of a Nijenhuis Lie
algebra and obtain a $2$-term Nijenhuis $L_\infty$-
algebra as the semidirect product. Finally, we show that the category of $2$-representations and the category of $2$-term representations up to homotopy of a Nijenhuis Lie
algebra are equivalent.
Read the full abstract ▾
Analysis of PDEs
Stability of Vortex Patches in Channels
Zelin Dong and Chenyun Luo
In this paper, we investigate the orbital stability of
vortex patches for the two-dimensional incompressible Euler equations in both a class of domains that satisfy the “weak finite volume condition" and a strip of arbitrary width. We establish that for suitable parameters $(\mu,\lambda)$, the penalized kinetic energy functional admits a minimizer, and that every such minimizer satisfies the
elliptic equation $\omega = \lambda(\psi - W x_2 - \gamma)_+$. Furthermore, we demonstrate that the set of minimizers is orbitally stable under the Eulerian dynamics. This work extends the variational framework developed by Abe and Choi to domains that lack both spatial scaling invariance and horizontal translation invariance. The absence of these properties introduces substantial difficulties in the proof, as classical rearrangement and scaling arguments are no longer applicable. We overcome these obstacles by comparing the Green's function with that of the half-plane and exploiting the decay condition to formulate a concentration-compactness argument that ultimately yields the desired stability result.
Read the full abstract ▾
Number Theory
A note on equidistribution on a product of Shimura curves and André–Oort
Francesco Maria Saettone
In this short note we show that Galois orbits of CM points equidistribute on a product of $r\ge 2$ non-isomorphic Shimura curves by applying the adelic toral-packet equidistribution
theorem of Aka–Luethi–Michel–Wieser. As a consequence, we deduce André–Oort for the product of those curves, previously studied by Edixhoven and Yafaev, replacing GRH by a Linnik-type splitting condition at two auxiliary
primes.
Read the full abstract ▾
Probability
Asymptotic properties for fully coupled delayed forward-backward stochastic differential equations
Auguste Aman and Clément Manga
We investigate the asymptotic behavior of solutions to a class of fully coupled forward-backward
stochastic differential equations with time-delayed generators. Such systems arise naturally in
stochastic models with
memory effects and constitute a significant extension of the classical fully coupled FBSDE framework. The presence of delay introduces additional analytical difficulties due to the dependence of the coefficients on the past trajectories of the solution processes and the resulting non-Markovian structure. Under suitable assumptions on the coefficients, we study the asymptotic properties of a perturbed delayed FBSDE driven by a small noise parameter. We first establish the convergence in distribution of the associated solution processes as the perturbation parameter tends to zero. We then prove almost sure convergence towards the solution of the corresponding deterministic limiting system. As a consequence of these asymptotic results, we derive a large deviation principle for the solution processes. Our results extend the asymptotic analysis of Cruzeiro, Gomes and Zhang (2014) from the classical fully coupled FBSDE setting to the delayed framework, and complement existing works on weakly coupled delayed forward-backward systems. They provide, to the best of our knowledge, the first large deviation principle for fully coupled forward-backward
stochastic differential equations with delayed generators.
Read the full abstract ▾
Mathematical Physics · Cross-listed from physics.flu-dyn
Linear Stability Analysis of Two-phase, Two-Component Flow in Porous Media
Paulo Lee Kung Caetano Chang and Kundan Kumar
Viscous fingering instabilities during fluid displacement in porous media can compromise the efficiency of applications such as enhanced oil recovery, CO2 sequestration, and groundwater remediation. While extensive research exists on linear stability analysis for fully immiscible and fully miscible displacements, the intermediate case of partially miscible flow with limited mass transfer between phases remains largely unexplored. This study extends linear stability analysis to a two-phase, two-component system that accounts for
gravity effects, fractional flow, capillary forces, mechanical dispersion, and interphase mass transfer, focusing on the case where a partially miscible gaseous fluid displaces a
liquid. We formulate an
eigenvalue problem to characterize instability growth rates and cutoff wavenumbers. The resulting ordinary differential equations have discontinuous coefficients at the transition from two-phase to pure-
liquid flow, resulting in discontinuous eigenfunction derivatives. We derive jump conditions for the derivatives at this transition, and solve the
eigenvalue problem using the matched initial value problem method. Results demonstrate that mass transfer has a pre-dominantly stabilizing effect by reducing viscosity contrast and altering shock properties at the displacement front. This stabilizing influence is particularly pronounced for high viscosity contrasts and dampens
gravity-induced instability in upward displacements. Mass transfer most significantly affects the perturbation growth rate, while its effect on the cutoff wavenumber is less pronounced. We identify a critical value for the dimensionless longitudinal dispersion coefficient where both growth rate and cutoff wavenumber are maximized, suggesting complex interactions between capillary forces and mechanical dispersion.
Read the full abstract ▾
Numerical Analysis
Structure-Oriented Randomized Neural Networks for Poisson-Nernst-Planck and Poisson-Nernst-Planck-Navier-Stokes Systems
Yunlong Li and Fei Wang
We develop a structure-oriented randomized neural network framework, termed SO-RaNN, for the Poisson-Nernst-Planck (PNP) system and the Poisson-Nernst-Planck-Navier-Stokes (PNP-NS) system. The decoupled linearized subproblems are solved iteratively by randomized neural networks in a space-time framework. For the concentration variables, a pointwise cut-off is used to enforce positivity at the value level, and discrete mass-scaling factors are computed at selected correction instants and interpolated in time, so as to ensure exact mass matching at those instants and to promote approximate mass preservation between them. To introduce an auxiliary discrete dissipation mechanism, we further employ an SAV-type post-processing correction, which yields monotonicity of the SAV auxiliary variable under the ideal SAV update. For the PNP-NS system, a structure-preserving randomized neural network (SP-RaNN) is used for the velocity field, so that the velocity approximation satisfies the incompressibility constraint pointwise by construction. On the theoretical side, we derive residual-based estimates for the raw, uncorrected RaNN solvers of the linearized subproblems, formulate a conditional local-in-time convergence result for the raw outer Picard iteration of the PNP system, and analyze the value-level positivity correction together with the mass-correction and SAV post-processing steps. For the PNP-NS system, we establish an approximation result for the SP-RaNN space and provide a conditional error statement for the corresponding linearized Oseen-type problem. Numerical experiments demonstrate approximation accuracy in the source-driven manufactured tests and illustrate the intended value-level positivity correction, selected-time mass matching, computed free-energy curves based on the final gauge-fixed potential, and divergence-free approximation in
benchmark tests.
Read the full abstract ▾
Probability · Cross-listed from stat.CO
Establishing an $\Omega(\sqrt{d})$ complexity lower bound for PDMP samplers and how to break it: a sub-$\sqrt{d}$ algorithm for Gaussian-tailed targets
Augustin Chevallier
Despite the theoretical appeal of their non-reversibility, to date, no Piecewise Deterministic Markov Process (PDMP) samplers have been developed that scale better than $\mathcal{O}(\sqrt{d})$ in computational complexity with respect to the target dimension $d$. We prove that this is a fundamental limitation by establishing an $\Omega(\sqrt{d})$ lower bound on the algorithmic complexity of PDMP samplers in a standard setup. By relaxing the assumption that the target density must remain invariant at all continuous times, we then demonstrate how to bypass this barrier. Specifically, we introduce a novel PDMP sampling scheme and show that it achieves an empirical complexity of $\mathcal{O}(d^\alpha)$, where $\alpha \in [0.2, 0.3]$ for Gaussian-tailed targets. In addition, this PDMP scheme is locally adaptive in both trajectory length and distance between velocity updates.
Read the full abstract ▾
Numerical Analysis
A fast direct solver based neural network for solving PDEs
Jashwanth Reddy Kadaru and Vaishnavi Gujjula
The
matrices arising from large scale $N$-body problems can be efficiently represented using hierarchical
matrices, whose key idea is that the admissible off-diagonal sub-
matrices can be well approximated by low-rank
matrices across a hierarchy of
matrix partitions. HODLR (Hierarchical Off-Diagonal Low-Rank)
matrices are a subclass of hierarchical
matrices in which all off-diagonal submatrices at every level of a recursive binary partition are low-rank. In this article, we present a neural network that learns the inverse operation of HODLR
matrices based on the fast direct solver for HODLR
matrices developed by Ambikasaran and Darve (2013). We further extend the architecture to learn nonlinear solution operators associated with PDEs by replacing some of the linear layers with deep sub-networks. We demonstrate the performance of the proposed architecture by performing a comprehensive set of experiments that include (i) solving a linear problem such as the Fredholm integral equation of the second kind, (ii) solving PDEs such as the nonlinear Schrödinger equation, Burgers' equation, and the steady-state Darcy's flow equation, (iii) generalization study across varying parameter values, (iv) comparing the inference time of the proposed network with the run time of a classical numerical solver, and (v) comparing the proposed network with some of the existing neural operator learning networks.
Read the full abstract ▾
Numerical Analysis
Invariant measures of the stochastic theta method for stochastic differential equations with super-linearly growing coefficients
Xiaotong Li, Wei Liu and Wenjie Xiao
The
stochastic theta method is proposed to approximate invariant measures of
stochastic differential equations (SDEs), both of whose drift and
diffusion coefficients may grow super-linearly. For the numerical solution generated by the
stochastic theta method, we show the existence and uniqueness of the numerical invariant measure first. Then, we prove that the numerical invariant measure is convergent to the exact invariant measure of the underlying SDE. We also provide some numerical simulations to illustrate our theoretical results. This work could be regarded as an extension of the results in [Y. Jiang et al, Numer.
Algorithms 83(4)(2020), pp. 1531-1553] to the case of super-linearly growing
diffusion coefficient. As the backward Euler-Maruyama (EM) method is a special case of the
stochastic theta method, the results derived in this work could also be regarded as a generalization of the results for the backward EM method in [W. Liu et al. Appl. Numer. Math. 184(2023), pp. 137-150] to the
stochastic theta method.
Read the full abstract ▾
Analysis of PDEs
Bifurcation of overdetermined capillary problems in a strip domain
Yuanyuan Lian and Pieralberto Sicbaldi
In this paper, we consider the classical overdetermined capillary problem: \begin{equation*} \begin{cases} \mathrm{div} \left(\frac{\nabla u}{\sqrt{1+|\nabla u|^2}}\right) - bu =0 &~~\mbox{in}~~ \Omega, \partial_{\nu} u=\kappa &~~\mbox{on}~~\partial\Omega, u=c &~~\mbox{on}~~\partial\Omega, \end{cases} \end{equation*} where $b$, $c$ and $\kappa$ are positive constants, and $\Omega\subset \mathbb{R}^2$. When $\Omega$ is an infinite strip, i.e., a domain bounded by two parallel straight lines, there exists a unique one-dimensional solution (called the trivial solution) to this problem. By means of a bifurcation argument, we establish the existence of a critical period $T_*$ at which a branch of non-trivial solutions bifurcates from the trivial one. These solutions are genuinely two-dimensional and are defined in unbounded periodic domains $\Omega$ that are diffeomorphic to an infinite strip, yet whose boundaries are no longer straight lines. This result offers a significant physical interpretation in the context of capillary phenomena.
Read the full abstract ▾
Group Theory
A Riesz-Thorin Approach to the Rapid Decay Property for Free Groups
Guillaume Delord
We establish $L^p$ bounds for operators associated with the quasi-regular representation of the free group on its Gromov boundary. The $p=2$ case recovers Haagerup's inequality, yielding a new interpolation-theoretic proof of the the Rapid Decay property for the free group.
Optimization and Control · Cross-listed from cs.LG
On the Oracle Complexity of Interpolation-Based Gradient Descent
Dongmin Lee, William Lu and Anuran Makur
Recent work on first-order optimizers for empirical risk minimization (ERM) has suggested that smoothness of ERM loss functions in the training data, rather than in the optimization parameters, can be leveraged to improve the oracle complexity of gradient descent (GD) methods. In this paper, we propose an inexact gradient method, piecewise
polynomial interpolation-based gradient descent (PPI-GD), which approximates the full gradient in each iteration by querying the first-order oracle at equidistant points in the data domain to construct
polynomial interpolants of the resulting gradient samples over appropriately sized patches of the data domain. We analyze the oracle complexity of PPI-GD for strongly convex and non-convex loss functions when the data space dimension is bounded by a polylogarithmic function of the number of training samples, and find it to outperform several GD variants in key regimes when the loss function is sufficiently smooth. Furthermore, our analysis extends several techniques from the error analysis of bicubic spline interpolants to the setting of $d$-variate tensor product
polynomial interpolants which may be of independent interest in interpolation analysis.
Read the full abstract ▾
Mathematical Physics · Cross-listed from hep-th
Factorized Quantum Curves and Minuscule Vertices in 3D Duality Cascades with FI Parameters
Sanefumi Moriyama
In the study of duality cascades in three-dimensional gauge theories without FI parameters, an important role is played by a fundamental domain whose vertices correspond to brane configurations with vanishing relative ranks. Through the
Fermi gas formalism, such brane configurations are known to be represented by factorized
quantum curves. In this paper, we show that this factorized description extends naturally to
quantum curves associated with del Pezzo geometries possessing exceptional Weyl-group
symmetries in the presence of FI parameters. We find that the vertices of the fundamental domain corresponding to the weights of minuscule representations are realized as factorized
quantum curves built from canonical operators interpreted as 5-branes dressed with FI parameters. This reveals an unexpected relation between factorized
quantum curves and minuscule representations, providing a physical realization of these vertices in terms of “extremal” brane configurations.
Read the full abstract ▾
Optimization and Control · Cross-listed from cs.LG
Global Convergence of Gradient Descent for Score Matching in Gaussian Mixtures via Reverse Fisher Divergence
Alexander Tyurin
The score matching problem is a central training objective in modern generative modeling,
diffusion models, fitting unnormalized statistical models, and inverse problems. A standard approach is to minimize the forward Fisher divergence, where the expectation is taken with respect to the teacher distribution. However, recent results show that even in simple Gaussian mixture model settings, this objective can lead to undesirable and initialization-dependent convergence behavior. In this paper, we study an alternative objective: the reverse Fisher divergence, where the expectation is taken with respect to the student distribution. We analyze gradient descent (GD) for fitting Gaussian mixture models and show that this change in the objective leads to significantly better optimization properties. First, when the teacher distribution is a single Gaussian and the student is a Gaussian mixture model with fixed weights and identity covariances, we prove the global convergence of GD from arbitrary initializations. Second, we extend the analysis to the case where the teacher is also a Gaussian mixture model and prove global convergence guarantees under a global random initialization scheme and a $\widetilde{\Omega}(1)$-separation assumption on the target means. In particular, with high probability, each student component converges near its closest teacher component, and we provide conditions under which the student distribution converges in total variation distance. Our proofs rely on a new Lyapunov-based analysis of the gradient descent dynamics, showing that the reverse Fisher divergence has a much more favorable optimization landscape than the forward Fisher divergence.
Read the full abstract ▾
Analysis of PDEs
Homogenization of the compressible Navier-Stokes equations via two-scale convergence in perforated domains
Markus Gahn, Kuntal Bhandari, Šárka Nečasová et al. (+1 more)
We study the homogenization of the compressible isentropic Navier-Stokes equations in periodically perforated domains where the size of the obstacles is of the same order as the distance between neighboring obstacles. Using the two-scale convergence method, which can be characterized via the unfolding operator, we derive the corresponding macroscopic model determined by Darcy's law. In particular, the macroscopic density satisfies the porous medium equation. The main challenge lies in identifying the pressure term in the limit. We overcome this by establishing the strong two-scale convergence of the densities, which is achieved by controlling the oscillation defect measure of the unfolded densities. A crucial contribution of our work is the development of a methodological framework applicable to more complex compressible fluid models. Furthermore, regarding conservative forces, we extend existing results from the literature to adiabatic constants $\gamma > \frac95$.
Read the full abstract ▾
All authors Markus Gahn, Kuntal Bhandari, Šárka Nečasová, Maria Neuss-Radu
Optimization and Control
Semiglobal Input-Delay Tolerance Algorithm for Distributed Nonconvex Optimization of Networked Nonlinear Systems
Jing-Zhe Xu, Zhi-Wei Liu, Ming-Feng Ge et al. (+2 more)
This paper studies a class of distributed optimization problems in networked nonlinear systems (NNSs) subject to input delays and consensus constraints. It introduces input-delay tolerant semiglobal convergence (IDTSC), meaning that for any prescribed compact initial set there exists an admissible delay bound under which the optimal solution is computed within consensus constraints and all node states converge to the solution. Building on a hierarchical design and input-to-state stability analysis, a new semiglobal input-delay tolerant (SIDT)
algorithm is developed that practically achieves IDTSC for distributed optimization under the coupling between input delays and nonlinear dynamics. Further, by relaxing strict convexity requirements through the Polyak-Łojasiewicz condition, the SIDT
algorithm broadens its applicability to nonconvex optimization. Finally, numerical experiments corroborate the theory on NNSs with input delays.
Read the full abstract ▾
All authors Jing-Zhe Xu, Zhi-Wei Liu, Ming-Feng Ge, Yan-Wu Wang, Dinxin He