Numerical Analysis · Cross-listed from cs.LG
Approximation Property of Dropout Neural Networks: Sobolev Rates and Confidence Bounds
Jia-He Yao
The universal approximation property of dropout neural networks does not by itself describe the network size required for an accurate random realization. In this work, we study approximation of the unit ball of $W^{n,\infty}([0,1]^d)$ by ReLU networks whose edges are retained independently with probability $p$. The approximation error is measured uniformly over the input domain, and the guarantee holds with probability at least $1-\delta$ for a single sampled network. We construct networks of constant depth and size $\widetilde O_{n,d}(p^{-9}\varepsilon^{-\max\{d/n,2\}} \log(1/\delta))$. The construction combines bounded local subnetworks, localization on a successful approximation event, and a multiscale Taylor decomposition. Conversely, Sobolev capacity imposes a lower bound on the number of surviving edges, while approximation of a fixed affine function requires an output-layer cost of order $((1-p)/p)\varepsilon^{-2}\log(1/\delta)$ at sufficiently high confidence. For fixed $p\in(0,1)$ and $\delta<\min\{1/2,1-p\}$, the upper and lower bounds match in the accuracy exponent under a fixed or logarithmic depth budget. When $d\leq2n$, they also match in confidence up to logarithms of accuracy. We extend the lower bounds to $W^{n,r}$ targets with $L^s$ error, and distinguish this extension from the upper bound for $W^{n,\infty}$. The optimal retention dependence and logarithmic factors remain open.
Read the full abstract ▾
Numerical Analysis
Matrix-Free Moment-Matching Method for Reduced-Order Modeling of Quadratic-Bilinear Descriptor Systems with Multiple Inputs
Zeyuan Gao, Cheol W. Lee and Oleg Zikanov
This paper develops a new moment-matching order reduction method for multi-input quadratic-bilinear descriptor systems. The proposed approach accommodates multiple inputs acting on both the differential and algebraic equations and constructs separate projection spaces associated with different input channels and input combinations. The method uses a
matrix-free
algorithm, allowing the reduced-order
matrices and tensors to be computed without explicitly assembling or storing the full-order system
matrices and tensors. This feature makes the proposed method particularly suitable for large-scale computational fluid dynamics problems. Numerical experiments carried out for two-dimensional flow problems demonstrate that the resulting reduced-order models accurately reproduce the transient responses of the full-order models under multiple time-varying inputs.
Read the full abstract ▾
Numerical Analysis
A relaxation system for the low-Mach limit of kinetic equations: Stability and higher order asymptotic preserving scheme
Giacomo Dimarco, Axel Klar, Theresa Köfler et al. (+3 more)
This work introduces a
hyperbolic relaxation system designed for the simulation of kinetic equations in the low-Mach number limit. The methodology is built upon a micro-macro decomposition of the scaled BGK model, which reformulates the kinetic distribution function into a coupled system consisting of a macroscopic
equilibrium part and a microscopic non-
equilibrium remainder. By projecting the microscopic deviations onto a set of orthogonal
polynomials, we derive a closed moment relaxation system. The resulting system is a version of Grad's 13 moment system with a linear
hyperbolic part and a relaxation adapted to the incompressible limit. We prove the model's structural stability in the incompressible Navier-Stokes limit. Moreover, we develop a high order Asymptotic-Preserving (AP) numerical framework using Implicit-Explicit (IMEX) Runge Kutta schemes for temporal accuracy and finite difference WENO reconstructions as well as central difference approximations for high order spatial resolution. The proposed scheme ensures uniform stability and consistency across different physical regimes, automatically degenerating into a consistent high order discretization of the incompressible thermal Navier-Stokes limit as the scaling parameter vanishes. Numerical experiments in one and two dimensions corroborate the theoretical findings, demonstrating significant reductions in computational cost and robust performance across a wide range of Knudsen and Mach numbers.
Read the full abstract ▾
All authors Giacomo Dimarco, Axel Klar, Theresa Köfler, Lorenzo Pareschi, Sudarshan Tiwari, Yizhou Zhou
Numerical Analysis · Cross-listed from stat.CO
Multifidelity Formulations for Triangular Transport
Owen Davis, Daniel Sharp, Youssef Marzouk et al. (+1 more)
We develop multifidelity methods for constructing triangular transport maps from samples, when high-fidelity data are scarce but lower-fidelity data are more abundant. Using this set of multifidelity data, we approximate a triangular transport map that bijectively maps between a tractable reference density and the high-fidelity target distribution. We introduce two strategies to leverage low-fidelity data: a hierarchical approach that composes maps between adjacent fidelity levels, and a non-hierarchical method that incorporates low-fidelity information through monotonicity-preserving corrections to the map parameterization. Numerical experiments compare these strategies with single-fidelity transport and demonstrate how the proposed multifidelity approaches can improve map estimation from limited high-fidelity data. To illustrate the broader utility of the learned maps, we also deploy them in a downstream amortized simulation-based inference task. This example shows that multifidelity improvements in map estimation can translate to improved conditional sampling and uncertainty quantification when high-fidelity data are scarce.
Read the full abstract ▾
All authors Owen Davis, Daniel Sharp, Youssef Marzouk, Gianluca Geraci
Numerical Analysis
A Fast Nonuniform Solver for the Poisson Equation over a Disk
Charlie Pyle and Prabir Daripa
We study fast numerical methods for the Poisson equation on a disk within the FFTRR (Fast
Fourier Transform Radial Recurrence) framework, which is built on Green's function representations. Classical FFTRR schemes apply FFTs in the azimuthal variable and evaluate mode-by-mode radial recurrences, achieving a complexity of \(O(MN\log N)\) on an \(N\times M\) uniform grid. However, they require a uniformly spaced azimuthal mesh of \(N\) points. In this work we develop a Nonuniform (NUFFTRR) solver that admits nonuniform grids in both the radial and azimuthal directions while retaining the favorable structure of the original FFTRR formulation. The azimuthal analysis-synthesis step is implemented using either a dense NUDFT least-squares solver or one of two NUFFT-based iterative schemes: a Toeplitz solver using circulant-preconditioned conjugate gradients (PCG), and a preconditioned conjugate gradient for least squares (PCGLS) solver with Pipe–Menon density compensation. These yield azimuthal complexities \(O(N^3 + MN^2)\) for the NUDFT variant and \(O(K_{\mathrm{iter}} MN\log N)\) for the NUFFT-based variants on an \(N\times M\) grid and Krylov iteration count \(K_{\mathrm{iter}}\). Numerical experiments on nonuniform meshes demonstrate that the proposed method is robust, spectrally accurate in the azimuthal variable, and competitive in runtime with existing fast Poisson solvers. We make use of vectorization and batched BLAS/GPU-accelerated linear
algebra operations to eliminate explicit loops while also formulating azimuthal and radial steps entirely in terms of dense array operations, FFTs, and NUFFTs, allowing for straightforward GPU acceleration. The implementation is released as an open-source Python package at https://github.com/CharliePyle4/NUFFTRR_Poisson, and its methodology can be extended directly to related elliptic problems such as the Helmholtz equation.
Read the full abstract ▾
Numerical Analysis · Cross-listed from cond-mat.str-el
adapol: Adaptive pole-fitting for quantum many-body physics
Zhen Huang, Chia-Nan Yeh, Lin Lin et al. (+3 more)
We describe adapol, a Python package for fitting Matsubara Green's functions, self-energies, and hybridization functions by a compact sum of simple poles with real pole locations and
matrix-valued residues. This pole-fitting step arises in many contexts, including hybridization fitting for
quantum impurity solvers based on exact diagonalization, perturbation theory, and tensor networks, the compression of existing pole expansions such as the discrete Lehmann representation, diagrammatic methods based on discrete pole representations, and the analytic continuation of Matsubara Green's functions. adapol uses a modified version of the AAA rational approximation
algorithm to estimate pole locations, and non-convex optimization to refine them. This procedure yields accurate and compact fits in a black-box and noise-robust manner. adapol provides a simple, self-contained interface with extensive documentation and examples, as well as an interface to the TRIQS package.
Read the full abstract ▾
All authors Zhen Huang, Chia-Nan Yeh, Lin Lin, Nils Wentzell, Jason Kaye, Hugo U. R. Strand
Numerical Analysis · Cross-listed from math.AP
Inverting the geodesic ray transform with finite measurements: stability and reconstruction
Yernat M. Assylbekov
We study the inversion of the geodesic ray transform from finitely many local averages of its data. Under suitable
geometric assumptions, we prove Lipschitz stability on any fixed finite-dimensional reconstruction space when the measurement partition is sufficiently fine. We develop convergent reconstruction
algorithms based on Steepest Gradient Descent and Conjugate Gradients and implement them using piecewise constant finite element spaces. Numerical experiments in 2D and 3D illustrate the influence of geometry and measurement discretization on reconstruction quality.
Read the full abstract ▾
Numerical Analysis
A Reduced Coupling-Space Multigrid Schur Preconditioner for Fictitious-Domain Interface Problems
Najwa Alshehri
We study a reduced multigrid Schur preconditioner for the fictitious-domain method with distributed Lagrange multipliers applied to elliptic interface problems. The method replaces the costly background solve by a multigrid approximation and treats the resulting correction only in the multiplier coupling space through a Woodbury formula. Numerical experiments show a marked improvement over the baseline preconditioner and consistently rapid convergence under mesh refinement and coefficient contrast.
Read the full abstract ▾
Numerical Analysis
A Pressure-Free Virtual Element Method for the Surface Stokes Problem
Jun Hu, Shengyang Xu and Hao Zhou
We develop a pressure-free virtual element method for the surface Stokes problem on polygonal approximations of closed surfaces of arbitrary genus. The method extends the planar VEM Stokes complex to discrete surfaces, yielding a nonconforming complex with an exactly tangential, $H(\operatorname{div})$-conforming velocity space, commuting interpolation, and the correct discrete cohomology. To obtain the weak consistency needed for optimal convergence, we introduce an edge correction that preserves the complex without adding degrees of freedom; the resulting construction reduces to the original complex in the planar setting. The virtual formulation requires no penalties, and a local divergence-preserving reconstruction provides a computable pressure-robust load. We also construct explicit macroelement representatives whose energy and load induce an alternative formulation on the VEM space, algebraically equivalent to a direct macroelement Galerkin method. The original virtual formulation and the macroelement method are stable and attain optimal first-order convergence in the broken $H^1$ norm and second-order convergence in the $L^2$ norm for the velocity. Numerical experiments illustrate these convergence rates, the role of the edge correction, and pressure robustness.
Read the full abstract ▾
Numerical Analysis · Cross-listed from math.PR
Computing Extinction Barriers in a Quorum-Sensing Reaction Network
Mario Ayala and Johannes Zimmer
We introduce a simple reaction-network model of a quorum-sensing population that couples the
cell density $x$ to the signal density $w$. In the four-channel
cell-signal network studied here, scaling signal production and removal by the same factor $r$ leaves all deterministic
equilibria, and their stability types, unchanged. Nevertheless, we show that $r$ shifts the quasipotential barrier $\Delta V(r)$ for rare transitions towards extinction, and thus, under metastable exit assumptions, the mean time to reach a fixed neighbourhood of the extinction state on the exponential scale $e^{N\Delta V(r)}$. We compute the barrier by minimization of the path action with the signal retained as a fluctuating coordinate, and we compare it with exact
stochastic simulation of population-threshold crossing times regressed in $N$. Over a range of $r$, the minimum-action barriers satisfy $\Delta V(r)=\Delta V_\infty+O(1/r)$, where $\Delta V_\infty$ is obtained by eliminating the signal first. At $r=1$, the barrier is 55% larger than $\Delta V_\infty$. The saddle barrier $\Delta V(r)$ is also the least action needed to enter the basin of extinction, but the density threshold can be crossed more cheaply: at $r=0.5$ the cheapest crossing costs 7.7% less action, keeps the signal high, and is usually followed by recovery. Simulated arrival times in this neighbourhood, which include failed attempts, grow with slopes within two fitted standard errors of the saddle barrier at every tested rate, and within $0.004$ of it if the logarithmic prefactor term is omitted. Under either regression model they exclude $\Delta V_\infty$ at $r\le2$ by at least $4.4$ fitted standard errors, without using the action solver.
Read the full abstract ▾
Numerical Analysis
Exact Representation of Piecewise Polynomial Finite Element Functions by Two-Hidden-Layer Multilayer Perceptrons
Jun Hu, Pengzhan Jin and Shengyang Xu
We construct exact representations of finite element functions of arbitrary
polynomial degree on simplicial meshes in any spatial dimension by two-hidden-layer multilayer perceptrons (MLPs). The first hidden layer uses $\mathrm{ReLU}^0+\mathrm{ReLU}$, and the second uses the degree-dependent activation $\mathrm{ReLU}^k$. The neural networks can realize both zero-skeleton and prescribed-skeleton representatives of discontinuous finite element functions, where the former vanish on the mesh skeleton and the latter admit independently prescribed
polynomial data on each relatively open lower-dimensional mesh subsimplex; in particular, continuous finite element functions can be represented pointwise on the closed domain. In the continuous case, a half-open decomposition reduces the second-hidden-layer width by assigning each subsimplex to a single incident element. The number of nonzero parameters grows linearly with the number of elements for fixed spatial dimension,
polynomial degree, and output dimension, and it is of the same order as the number of global degrees of freedom of the finite element space in the continuous case, provided that the mesh is shape-regular. All parameters in the neural network can be explicitly computed via the information of the mesh and finite element function without training.
Read the full abstract ▾
Numerical Analysis
Exact barycentric rational interpolation of analytic functions with an application to the Bessel functions
Brett R. Green
We derive a method of analytic function expansion using barycentric rational interpolation, in which an arbitrary analytic weight function defines the interpolation and nodes. Truncating these expansions yields successive approximations, and the derivation of the expansions gives the approximation error as a byproduct. We demonstrate the method with cosine and the Bessel functions of the first kind for several choices of weight functions, and we examine the accuracy and convergence of the approximate interpolations as a function of the weight and the number of nodes used in the interpolation.
Read the full abstract ▾
Numerical Analysis
On the linearised force balance condition in the analysis of atomistic dislocation models
Julian Braun and Thomas Hudson
A technical condition arising in the analysis of atomistic models for dislocations is studied. Key estimates for the far-field strain behaviour proved in Ehrlacher, Ortner, Shapeev (2016) rely on a summation-by-parts argument for linearised forces, under conditions of sufficient decay and of vanishing net force in an infinite system. In particular, the latter condition is required for an application of this theory to the standard far-field dislocation predictor, but the vanishing of the associated force sum has not been fully justified. Here, the missing verification of this condition is provided and its role in determining the far-field decay of the corrector is clarified. It is moreover shown that for more general physically compatible predictors, the linearised force sum need not vanish, leading to slower decay and potentially divergent finite-domain approximations.
Read the full abstract ▾