We gratefully acknowledge support from
the Simons Foundation and member institutions.

Numerical Analysis

New submissions

[ total of 24 entries: 1-24 ]
[ showing up to 2000 entries per page: fewer | more ]

New submissions for Fri, 15 Oct 21

[1]  arXiv:2110.06988 [pdf, other]
Title: Spectral Convergence of Symmetrized Graph Laplacian on manifolds with boundary
Comments: 6 figures
Subjects: Numerical Analysis (math.NA)

We study the spectral convergence of a symmetrized Graph Laplacian matrix induced by a Gaussian kernel evaluated on pairs of embedded data, sampled from a manifold with boundary, a sub-manifold of $\mathbb{R}^m$. Specifically, we deduce the convergence rates for eigenpairs of the discrete Graph-Laplacian matrix to the eigensolutions of the Laplace-Beltrami operator that are well-defined on manifolds with boundary, including the homogeneous Neumann and Dirichlet boundary conditions. For the Dirichlet problem, we deduce the convergence of the \emph{truncated Graph Laplacian}, which is recently numerically observed in applications, and provide a detailed numerical investigation on simple manifolds. Our method of proof relies on the min-max argument over a compact and symmetric integral operator, leveraging the RKHS theory for spectral convergence of integral operator and a recent pointwise asymptotic result of a Gaussian kernel integral operator on manifolds with boundary.

[2]  arXiv:2110.07037 [pdf, ps, other]
Title: Solving multiscale steady radiative transfer equation using neural networks with uniform stability
Subjects: Numerical Analysis (math.NA)

This paper concerns solving the steady radiative transfer equation with diffusive scaling, using the physics informed neural networks (PINNs). The idea of PINNs is to minimize a least-square loss function, that consists of the residual from the governing equation, the mismatch from the boundary conditions, and other physical constraints such as conservation. It is advantageous of being flexible and easy to execute, and brings the potential for high dimensional problems. Nevertheless, due the presence of small scales, the vanilla PINNs can be extremely unstable for solving multiscale steady transfer equations. In this paper, we propose a new formulation of the loss based on the macro-micro decomposition. We prove that, the new loss function is uniformly stable with respect to the small Knudsen number in the sense that the $L^2$-error of the neural network solution is uniformly controlled by the loss. When the boundary condition is an-isotropic, a boundary layer emerges in the diffusion limit and therefore brings an additional difficulty in training the neural network. To resolve this issue, we include a boundary layer corrector that carries over the sharp transition part of the solution and leaves the rest easy to be approximated. The effectiveness of the new methodology is demonstrated in extensive numerical examples.

[3]  arXiv:2110.07079 [pdf, other]
Title: Modelling wave propagation in elastic solids via high-order accurate implicit-mesh discontinuous Galerkin methods
Subjects: Numerical Analysis (math.NA)

A high-order accurate implicit-mesh discontinuous Galerkin framework for wave propagation in single-phase and bi-phase solids is presented. The framework belongs to the embedded-boundary techniques and its novelty regards the spatial discretization, which enables boundary and interface conditions to be enforced with high-order accuracy on curved embedded geometries. High-order accuracy is achieved via high-order quadrature rules for implicitly-defined domains and boundaries, whilst a cell-merging strategy addresses the presence of small cut cells. The framework is used to discretize the governing equations of elastodynamics, written using a first-order hyperbolic momentum-strain formulation, and an exact Riemann solver is employed to compute the numerical flux at the interface between dissimilar materials with general anisotropic properties. The space-discretized equations are then advanced in time using explicit high-order Runge-Kutta algorithms. Several two- and three-dimensional numerical tests including dynamic adaptive mesh refinement are presented to demonstrate the high-order accuracy and the capability of the method in the elastodynamic analysis of single- and bi-phases solids containing complex geometries.

[4]  arXiv:2110.07099 [pdf, ps, other]
Title: An Energy-Based Discontinuous Galerkin Method with Tame CFL Numbers for the Wave Equation
Comments: 20 pages
Subjects: Numerical Analysis (math.NA)

We extend and analyze the energy-based discontinuous Galerkin method for second order wave equations on staggered and structured meshes. By combining spatial staggering with local time-stepping near boundaries, the method overcomes the typical numerical stiffness associated with high order piecewise polynomial approximations. In one space dimension with periodic boundary conditions and suitably chosen numerical fluxes, we prove bounds on the spatial operators that establish stability for CFL numbers $c \frac {\Delta t}{h} < C$ independent of order when stability-enhanced explicit time-stepping schemes of matching order are used. For problems on bounded domains and in higher dimensions we demonstrate numerically that one can march explicitly with large time steps at high order temporal and spatial accuracy.

[5]  arXiv:2110.07126 [pdf, ps, other]
Title: Root Finding With Interval Arithmetic
Subjects: Numerical Analysis (math.NA)

We consider the solution of nonlinear equations in one real variable, the problem usually called by root finding. Although this is an old problem, we believe that some aspects of its solution using interval arithmetic are not well understood, and we present our views on this subject. We argue that problems with just one variable are much simpler than problems with more variables, and we should use specific methods for them. We provide an implementation of our ideas in C++, and make this code available under the Mozilla Public License 2.0.

[6]  arXiv:2110.07163 [pdf, other]
Title: A Data Analysis Study on Human Liver Blood Circulation
Subjects: Numerical Analysis (math.NA)

The liver has a unique blood supply system and plays an important role in the human blood circulatory system. Thus, hemodynamic problems related to the liver serve as an important part in clinical diagnosis and treatment. Although estimating parameters in these hemodynamic models is essential to the study of liver models, due to the limitations of medical measurement methods and constraints of ethics on clinical studies, it is impossible to directly measure the parameters of blood vessels in livers. Furthermore, as an important part of the systemic blood circulation, livers' studies are supposed to be in conjunction with other blood vessels. In this article, we present an innovative method to fix parameters of an individual liver in a human blood circulation using non-invasive clinical measurements. The method consists of a 1-D blood flow model of human arteries and veins, a 0-D model reflecting the peripheral resistance of capillaries and a lumped parameter circuit model for human livers. We apply the finite element method in fluid mechanics of these models to a numerical study, based on non-invasive blood related measures of 33 individuals. The estimated results of human blood vessel characteristic and liver model parameters are verified from the perspective of Stroke Value Variation, which shows the effectiveness of our estimation method.

[7]  arXiv:2110.07172 [pdf, other]
Title: Additive Schwarz Methods for Convex Optimization with Backtracking
Authors: Jongho Park
Comments: 20 pages, 3 figures
Subjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)

This paper presents a novel backtracking strategy for additive Schwarz methods for general convex optimization problems as an acceleration scheme. The proposed backtracking strategy is independent of local solvers, so that it can be applied to any algorithms that can be represented in an abstract framework of additive Schwarz methods. Allowing for adaptive increasing and decreasing of the step size along the iterations, the convergence rate of an algorithm is greatly improved. Improved convergence rate of the algorithm is proven rigorously. In addition, combining the proposed backtracking strategy with a momentum acceleration technique, we propose a further accelerated additive Schwarz method. Numerical results for various convex optimization problems that support our theory are presented.

[8]  arXiv:2110.07173 [pdf, ps, other]
Title: Adaptive Padé-Chebyshev Type Approximation of Piecewise Smooth Functions
Authors: S. Akansha, S. Baskar
Comments: This is the second version of our previously submitted article on the same title. arXiv admin note: substantial text overlap with arXiv:1910.10385
Subjects: Numerical Analysis (math.NA)

A piecewise Pad\'e-Chebyshev type (PiPCT) approximation method is proposed to minimize the Gibbs phenomenon in approximating piecewise smooth functions. A theorem on $L^1$-error estimate is proved for sufficiently smooth functions using a decay property of the Chebyshev coefficients. Numerical experiments are performed to show that the PiPCT method accurately captures isolated singularities of a function without using the positions and the types of singularities. Further, an adaptive partition approach to the PiPCT method is developed (referred to as the APiPCT method) to achieve the required accuracy with a lesser computational cost. Numerical experiments are performed to show some advantages of using the PiPCT and APiPCT methods compared to some well-known methods in the literature.

[9]  arXiv:2110.07270 [pdf, other]
Title: Spherical polar coordinate transformation for integration of singular functions on tetrahedra
Subjects: Numerical Analysis (math.NA)

A method is presented for the evaluation of integrals on tetrahedra where the integrand has a singularity at one vertex. The approach uses a transformation to spherical polar coordinates which explicitly eliminates the singularity and facilitates the evaluation of integration limits. The method can also be implemented in an adaptive form which gives convergence to a required tolerance. Results from the method are compared to the output from an exact analytical method and show high accuracy. In particular, when the adaptive algorithm is used, highly accurate results are found for poorly conditioned tetrahedra which normally present difficulties for numerical quadrature techniques.

[10]  arXiv:2110.07362 [pdf, other]
Title: Preconditioners for robust optimal control problems under uncertainty
Comments: 30 pages, 4 figures
Subjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)

The discretization of robust quadratic optimal control problems under uncertainty using the finite element method and the stochastic collocation method leads to large saddle-point systems, which are fully coupled across the random realizations. Despite its relevance for numerous engineering problems, the solution of such systems is notoriusly challenging. In this manuscript, we study efficient preconditioners for all-at-once approaches using both an algebraic and an operator preconditioning framework. We show in particular that for values of the regularization parameter not too small, the saddle-point system can be efficiently solved by preconditioning in parallel all the state and adjoint equations. For small values of the regularization parameter, robustness can be recovered by the additional solution of a small linear system, which however couples all realizations. A mean approximation and a Chebyshev semi-iterative method are investigated to solve this reduced system. Our analysis considers a random elliptic partial differential equation whose diffusion coefficient $\kappa(x,\omega)$ is modeled as an almost surely continuous and positive random field, though not necessarily uniformly bounded and coercive. We further provide estimates on the dependence of the preconditioned system on the variance of the random field. Such estimates involve either the first or second moment of the random variables $1/\min_{x\in \overline{D}} \kappa(x,\omega)$ and $\max_{x\in \overline{D}}\kappa(x,\omega)$, where $D$ is the spatial domain. The theoretical results are confirmed by numerical experiments, and implementation details are further addressed.

[11]  arXiv:2110.07398 [pdf, other]
Title: The Time Domain Linear Sampling Method for Determining the Shape of a Scatterer using Electromagnetic Waves
Subjects: Numerical Analysis (math.NA); Computational Physics (physics.comp-ph)

The time domain linear sampling method (TD-LSM) solves inverse scattering problems using time domain data by creating an indicator function for the support of the unknown scatterer. It involves only solving a linear integral equation called the near-field equation using different data from sampling points that probe the domain where the scatterer is located. To date, the method has been used for the acoustic wave equation and has been tested for several different types of scatterers, i.e. sound hard, impedance, and penetrable, and for wave-guides. In this paper, we extend the TD-LSM to the time dependent Maxwell's system with impedance boundary conditions - a similar analysis handles the case of a perfectly electrically conducting (PEC) body. We provide an analysis that supports the use of the TD-LSM for this problem, and preliminary numerical tests of the algorithm. Our analysis relies on the Laplace transform approach previously used for the acoustic wave equation. This is the first application of the TD-LSM in electromagnetism.

[12]  arXiv:2110.07486 [pdf, other]
Title: Robust monolithic solvers for the Stokes-Darcy problem with the Darcy equation in primal form
Subjects: Numerical Analysis (math.NA)

We construct mesh-independent and parameter-robust monolithic solvers for the coupled primal Stokes-Darcy problem. Three different formulations and their discretizations in terms of conforming and non-conforming finite element methods and finite volume methods are considered. In each case, robust preconditioners are derived using a unified theoretical framework. In particular, the suggested preconditioners utilize operators in fractional Sobolev spaces. Numerical experiments demonstrate the parameter-robustness of the proposed solvers.

Cross-lists for Fri, 15 Oct 21

[13]  arXiv:2110.07034 (cross-list from cs.LG) [pdf, other]
Title: How Does Momentum Benefit Deep Neural Networks Architecture Design? A Few Case Studies
Comments: 42 pages, 15 figures. arXiv admin note: text overlap with arXiv:2110.04840
Subjects: Machine Learning (cs.LG); Dynamical Systems (math.DS); Numerical Analysis (math.NA)

We present and review an algorithmic and theoretical framework for improving neural network architecture design via momentum. As case studies, we consider how momentum can improve the architecture design for recurrent neural networks (RNNs), neural ordinary differential equations (ODEs), and transformers. We show that integrating momentum into neural network architectures has several remarkable theoretical and empirical benefits, including 1) integrating momentum into RNNs and neural ODEs can overcome the vanishing gradient issues in training RNNs and neural ODEs, resulting in effective learning long-term dependencies. 2) momentum in neural ODEs can reduce the stiffness of the ODE dynamics, which significantly enhances the computational efficiency in training and testing. 3) momentum can improve the efficiency and accuracy of transformers.

[14]  arXiv:2110.07217 (cross-list from physics.ao-ph) [pdf, other]
Title: Alpine Permafrost Modeling: On the influence of topography driven lateral fluxes
Comments: 20 pages (without appendix), 9 figures
Subjects: Atmospheric and Oceanic Physics (physics.ao-ph); Numerical Analysis (math.NA)

Alpine permafrost environments are highly vulnerable and sensitive to changes in regional and global climate trends. Thawing and degradation of permafrost has numerous adverse environmental, economic, and societal impacts. Mathematical modeling and numerical simulations provide powerful tools for predicting the degree of degradation and evolution of subsurface permafrost as a result of global warming. A particularly significant characteristic of alpine environments is the high variability in their topography and geomorphology which drives large lateral thermal and fluid fluxes. Additionally, harsh winds, extreme weather conditions, and various degrees of saturation have to be considered. The combination of large lateral fluxes and unsaturated ground makes alpine systems markedly different from Arctic permafrost environments and general geotechnical ground freezing applications, and therefore, alpine permafrost demands its own specialized modeling approaches. In this research work, we present a multi-physics permafrost model tailored to alpine regions. In particular, we resolve the ice-water phase transitions, unsaturated conditions, and capillary actions, and account for the impact of the evolving pore volume on fluid-matrix interactions. Moreover, the approach is multi-dimensional, and therefore, inherently resolves fluxes along topographic gradients. Through numerical cases studies based on the elevation profiles of the two prominent peaks of the Zugspitze (DE) and the Matterhorn (CH), we show the strong influence of topography driven thermal and fluid fluxes on active layer dynamics and the distribution of permafrost.

[15]  arXiv:2110.07403 (cross-list from math.AG) [pdf, ps, other]
Title: A more direct and better variant of New Q-Newton's method Backtracking for m equations in m variables
Comments: 6 pages
Subjects: Algebraic Geometry (math.AG); Complex Variables (math.CV); Dynamical Systems (math.DS); Numerical Analysis (math.NA); Optimization and Control (math.OC)

In this paper we propose a variant of New Q-Newton's method Backtracking (which is relevant to Levenberg-Marquardt algorithm, but with the argumentation chosen by New Q-Newton's method idea for good theoretical guarantee, and with Backtracking line search added) for to use specifically with systems of m equations in m variables.
We fix $\delta _0=0 $ and $\delta _1=2$, and a number $0<\tau <1$. If $A$ is a square matrix, we denote by $minsp(A)=\min \{|\lambda |: $ $\lambda$ is an eigenvalue of $A\}$. Also, we denote by $A^{\intercal}$ the transpose of $A$.
Given $F:\mathbb{R}^m\rightarrow \mathbb{R}^m$ a $C^1$ function, we denote by $H(x)=JF(x)$ the Jacobian of $F$, and $f(x)=||F(x)||^2$. If $x\in \mathbb{R}^m$ is such that $F(x)\not= 0$, we define various :
$\delta (x)$ be the first element $\delta _j$ in $\{\delta _0,\delta _1\}$ so that $minsp(H(x)+\delta _j||F(x)||^{\tau } )\geq \min \{ ||F(x)||^{\tau},1\}$;
$A(x)=H(x)^{\intercal}H(x)+\delta (x)||F(x)||^{\tau }Id$;
$w(x)=A(x)^{-1}H(x)^{\intercal}F(x)$; (if $x$ is close to a non-degenerate zero of $F$, then $w(x)=H(x)^{-1}F(x)$ the usual Newton's direction) Note: we can normalise $w(x)/\max \{||w(x)|| ,1\}$ if needed
$\gamma (x)$ is chosen from Armijo's Backtracking line search: it is the largest number $\gamma$ among $\{1,1/2,(1/2)^2,\ldots \}$ so that: $f(x-\gamma w(x))-f(x)\leq -\gamma <w(x),H(x)^{\intercal}F(x)>$;
The update rule of our method is $x\mapsto x-\gamma (x)w(x)$.
Good theoretical guarantees are proven, in particular for systems of polynomial equations. In "generic situations", we will also discuss a way to avoid that the limit of the constructed sequence is a solution of $H(x)^{\intercal}F(x)=0$ but not of $F(x)=0$.

[16]  arXiv:2110.07492 (cross-list from quant-ph) [pdf, other]
Title: A Theory of Quantum Subspace Diagonalization
Comments: 42 pages, 13 figures
Subjects: Quantum Physics (quant-ph); Numerical Analysis (math.NA)

Quantum subspace diagonalization methods are an exciting new class of algorithms for solving large scale eigenvalue problems using quantum computers. Unfortunately, these methods require the solution of an ill-conditioned generalized eigenvalue problem, with a matrix pencil corrupted by a non-negligible amount of noise that is far above the machine precision. Despite pessimistic predictions from classical perturbation theories, these methods can perform reliably well if the generalized eigenvalue problem is solved using a standard truncation strategy. We provide a theoretical analysis of this surprising phenomenon, proving that under certain natural conditions, a quantum subspace diagonalization algorithm can accurately compute the smallest eigenvalue of a large Hermitian matrix. We give numerical experiments demonstrating the effectiveness of the theory and providing practical guidance for the choice of truncation level.

Replacements for Fri, 15 Oct 21

[17]  arXiv:2005.12161 (replaced) [pdf, ps, other]
Title: Triangularized Orthogonalization-free Method for Solving Extreme Eigenvalue Problems
Subjects: Numerical Analysis (math.NA)
[18]  arXiv:2102.12778 (replaced) [pdf, other]
Title: Lie Group integrators for mechanical systems
Comments: 35 pages
Subjects: Numerical Analysis (math.NA); Dynamical Systems (math.DS)
[19]  arXiv:2109.11436 (replaced) [pdf, ps, other]
Title: Piecewise Padé-Chebyshev Reconstruction of Bivariate Piecewise Smooth Functions
Authors: Akansha Singh
Comments: 26 pages, 15 figures
Subjects: Numerical Analysis (math.NA)
[20]  arXiv:2110.02665 (replaced) [pdf, ps, other]
Title: A structure preserving shift-invert infinite Arnoldi algorithm for a class of delay eigenvalue problems with Hamiltonian symmetry
Subjects: Numerical Analysis (math.NA)
[21]  arXiv:2002.08724 (replaced) [pdf, ps, other]
Title: High-resolution signal recovery via generalized sampling and functional principal component analysis
Authors: Milana Gataric
Comments: Accepted for publication in Springer's Advances in Computational Mathematics
Subjects: Statistics Theory (math.ST); Signal Processing (eess.SP); Numerical Analysis (math.NA); Machine Learning (stat.ML)
[22]  arXiv:2102.07833 (replaced) [pdf, other]
Title: Quasi-Monte Carlo Software
Comments: 25 pages, 7 figures, to be published in the MCQMC2020 Proceedings
Subjects: Mathematical Software (cs.MS); Numerical Analysis (math.NA)
[23]  arXiv:2107.12527 (replaced) [pdf, ps, other]
Title: Physics-Enforced Modeling for Insertion Loss of Transmission Lines by Deep Neural Networks
Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA)
[24]  arXiv:2110.01601 (replaced) [pdf, other]
Title: NeuFENet: Neural Finite Element Solutions with Theoretical Bounds for Parametric PDEs
Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA)
[ total of 24 entries: 1-24 ]
[ showing up to 2000 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, cs, recent, 2110, contact, help  (Access key information)