Numerical Analysis
New submissions
[ showing up to 2000 entries per page: fewer  more ]
New submissions for Fri, 15 Oct 21
 [1] arXiv:2110.06988 [pdf, other]

Title: Spectral Convergence of Symmetrized Graph Laplacian on manifolds with boundaryComments: 6 figuresSubjects: Numerical Analysis (math.NA)
We study the spectral convergence of a symmetrized Graph Laplacian matrix induced by a Gaussian kernel evaluated on pairs of embedded data, sampled from a manifold with boundary, a submanifold of $\mathbb{R}^m$. Specifically, we deduce the convergence rates for eigenpairs of the discrete GraphLaplacian matrix to the eigensolutions of the LaplaceBeltrami operator that are welldefined on manifolds with boundary, including the homogeneous Neumann and Dirichlet boundary conditions. For the Dirichlet problem, we deduce the convergence of the \emph{truncated Graph Laplacian}, which is recently numerically observed in applications, and provide a detailed numerical investigation on simple manifolds. Our method of proof relies on the minmax argument over a compact and symmetric integral operator, leveraging the RKHS theory for spectral convergence of integral operator and a recent pointwise asymptotic result of a Gaussian kernel integral operator on manifolds with boundary.
 [2] arXiv:2110.07037 [pdf, ps, other]

Title: Solving multiscale steady radiative transfer equation using neural networks with uniform stabilitySubjects: Numerical Analysis (math.NA)
This paper concerns solving the steady radiative transfer equation with diffusive scaling, using the physics informed neural networks (PINNs). The idea of PINNs is to minimize a leastsquare loss function, that consists of the residual from the governing equation, the mismatch from the boundary conditions, and other physical constraints such as conservation. It is advantageous of being flexible and easy to execute, and brings the potential for high dimensional problems. Nevertheless, due the presence of small scales, the vanilla PINNs can be extremely unstable for solving multiscale steady transfer equations. In this paper, we propose a new formulation of the loss based on the macromicro decomposition. We prove that, the new loss function is uniformly stable with respect to the small Knudsen number in the sense that the $L^2$error of the neural network solution is uniformly controlled by the loss. When the boundary condition is anisotropic, a boundary layer emerges in the diffusion limit and therefore brings an additional difficulty in training the neural network. To resolve this issue, we include a boundary layer corrector that carries over the sharp transition part of the solution and leaves the rest easy to be approximated. The effectiveness of the new methodology is demonstrated in extensive numerical examples.
 [3] arXiv:2110.07079 [pdf, other]

Title: Modelling wave propagation in elastic solids via highorder accurate implicitmesh discontinuous Galerkin methodsSubjects: Numerical Analysis (math.NA)
A highorder accurate implicitmesh discontinuous Galerkin framework for wave propagation in singlephase and biphase solids is presented. The framework belongs to the embeddedboundary techniques and its novelty regards the spatial discretization, which enables boundary and interface conditions to be enforced with highorder accuracy on curved embedded geometries. Highorder accuracy is achieved via highorder quadrature rules for implicitlydefined domains and boundaries, whilst a cellmerging strategy addresses the presence of small cut cells. The framework is used to discretize the governing equations of elastodynamics, written using a firstorder hyperbolic momentumstrain formulation, and an exact Riemann solver is employed to compute the numerical flux at the interface between dissimilar materials with general anisotropic properties. The spacediscretized equations are then advanced in time using explicit highorder RungeKutta algorithms. Several two and threedimensional numerical tests including dynamic adaptive mesh refinement are presented to demonstrate the highorder accuracy and the capability of the method in the elastodynamic analysis of single and biphases solids containing complex geometries.
 [4] arXiv:2110.07099 [pdf, ps, other]

Title: An EnergyBased Discontinuous Galerkin Method with Tame CFL Numbers for the Wave EquationComments: 20 pagesSubjects: Numerical Analysis (math.NA)
We extend and analyze the energybased discontinuous Galerkin method for second order wave equations on staggered and structured meshes. By combining spatial staggering with local timestepping near boundaries, the method overcomes the typical numerical stiffness associated with high order piecewise polynomial approximations. In one space dimension with periodic boundary conditions and suitably chosen numerical fluxes, we prove bounds on the spatial operators that establish stability for CFL numbers $c \frac {\Delta t}{h} < C$ independent of order when stabilityenhanced explicit timestepping schemes of matching order are used. For problems on bounded domains and in higher dimensions we demonstrate numerically that one can march explicitly with large time steps at high order temporal and spatial accuracy.
 [5] arXiv:2110.07126 [pdf, ps, other]

Title: Root Finding With Interval ArithmeticAuthors: Walter F. MascarenhasSubjects: Numerical Analysis (math.NA)
We consider the solution of nonlinear equations in one real variable, the problem usually called by root finding. Although this is an old problem, we believe that some aspects of its solution using interval arithmetic are not well understood, and we present our views on this subject. We argue that problems with just one variable are much simpler than problems with more variables, and we should use specific methods for them. We provide an implementation of our ideas in C++, and make this code available under the Mozilla Public License 2.0.
 [6] arXiv:2110.07163 [pdf, other]

Title: A Data Analysis Study on Human Liver Blood CirculationSubjects: Numerical Analysis (math.NA)
The liver has a unique blood supply system and plays an important role in the human blood circulatory system. Thus, hemodynamic problems related to the liver serve as an important part in clinical diagnosis and treatment. Although estimating parameters in these hemodynamic models is essential to the study of liver models, due to the limitations of medical measurement methods and constraints of ethics on clinical studies, it is impossible to directly measure the parameters of blood vessels in livers. Furthermore, as an important part of the systemic blood circulation, livers' studies are supposed to be in conjunction with other blood vessels. In this article, we present an innovative method to fix parameters of an individual liver in a human blood circulation using noninvasive clinical measurements. The method consists of a 1D blood flow model of human arteries and veins, a 0D model reflecting the peripheral resistance of capillaries and a lumped parameter circuit model for human livers. We apply the finite element method in fluid mechanics of these models to a numerical study, based on noninvasive blood related measures of 33 individuals. The estimated results of human blood vessel characteristic and liver model parameters are verified from the perspective of Stroke Value Variation, which shows the effectiveness of our estimation method.
 [7] arXiv:2110.07172 [pdf, other]

Title: Additive Schwarz Methods for Convex Optimization with BacktrackingAuthors: Jongho ParkComments: 20 pages, 3 figuresSubjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)
This paper presents a novel backtracking strategy for additive Schwarz methods for general convex optimization problems as an acceleration scheme. The proposed backtracking strategy is independent of local solvers, so that it can be applied to any algorithms that can be represented in an abstract framework of additive Schwarz methods. Allowing for adaptive increasing and decreasing of the step size along the iterations, the convergence rate of an algorithm is greatly improved. Improved convergence rate of the algorithm is proven rigorously. In addition, combining the proposed backtracking strategy with a momentum acceleration technique, we propose a further accelerated additive Schwarz method. Numerical results for various convex optimization problems that support our theory are presented.
 [8] arXiv:2110.07173 [pdf, ps, other]

Title: Adaptive PadéChebyshev Type Approximation of Piecewise Smooth FunctionsComments: This is the second version of our previously submitted article on the same title. arXiv admin note: substantial text overlap with arXiv:1910.10385Subjects: Numerical Analysis (math.NA)
A piecewise Pad\'eChebyshev type (PiPCT) approximation method is proposed to minimize the Gibbs phenomenon in approximating piecewise smooth functions. A theorem on $L^1$error estimate is proved for sufficiently smooth functions using a decay property of the Chebyshev coefficients. Numerical experiments are performed to show that the PiPCT method accurately captures isolated singularities of a function without using the positions and the types of singularities. Further, an adaptive partition approach to the PiPCT method is developed (referred to as the APiPCT method) to achieve the required accuracy with a lesser computational cost. Numerical experiments are performed to show some advantages of using the PiPCT and APiPCT methods compared to some wellknown methods in the literature.
 [9] arXiv:2110.07270 [pdf, other]

Title: Spherical polar coordinate transformation for integration of singular functions on tetrahedraAuthors: Michael J. CarleySubjects: Numerical Analysis (math.NA)
A method is presented for the evaluation of integrals on tetrahedra where the integrand has a singularity at one vertex. The approach uses a transformation to spherical polar coordinates which explicitly eliminates the singularity and facilitates the evaluation of integration limits. The method can also be implemented in an adaptive form which gives convergence to a required tolerance. Results from the method are compared to the output from an exact analytical method and show high accuracy. In particular, when the adaptive algorithm is used, highly accurate results are found for poorly conditioned tetrahedra which normally present difficulties for numerical quadrature techniques.
 [10] arXiv:2110.07362 [pdf, other]

Title: Preconditioners for robust optimal control problems under uncertaintyComments: 30 pages, 4 figuresSubjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)
The discretization of robust quadratic optimal control problems under uncertainty using the finite element method and the stochastic collocation method leads to large saddlepoint systems, which are fully coupled across the random realizations. Despite its relevance for numerous engineering problems, the solution of such systems is notoriusly challenging. In this manuscript, we study efficient preconditioners for allatonce approaches using both an algebraic and an operator preconditioning framework. We show in particular that for values of the regularization parameter not too small, the saddlepoint system can be efficiently solved by preconditioning in parallel all the state and adjoint equations. For small values of the regularization parameter, robustness can be recovered by the additional solution of a small linear system, which however couples all realizations. A mean approximation and a Chebyshev semiiterative method are investigated to solve this reduced system. Our analysis considers a random elliptic partial differential equation whose diffusion coefficient $\kappa(x,\omega)$ is modeled as an almost surely continuous and positive random field, though not necessarily uniformly bounded and coercive. We further provide estimates on the dependence of the preconditioned system on the variance of the random field. Such estimates involve either the first or second moment of the random variables $1/\min_{x\in \overline{D}} \kappa(x,\omega)$ and $\max_{x\in \overline{D}}\kappa(x,\omega)$, where $D$ is the spatial domain. The theoretical results are confirmed by numerical experiments, and implementation details are further addressed.
 [11] arXiv:2110.07398 [pdf, other]

Title: The Time Domain Linear Sampling Method for Determining the Shape of a Scatterer using Electromagnetic WavesSubjects: Numerical Analysis (math.NA); Computational Physics (physics.compph)
The time domain linear sampling method (TDLSM) solves inverse scattering problems using time domain data by creating an indicator function for the support of the unknown scatterer. It involves only solving a linear integral equation called the nearfield equation using different data from sampling points that probe the domain where the scatterer is located. To date, the method has been used for the acoustic wave equation and has been tested for several different types of scatterers, i.e. sound hard, impedance, and penetrable, and for waveguides. In this paper, we extend the TDLSM to the time dependent Maxwell's system with impedance boundary conditions  a similar analysis handles the case of a perfectly electrically conducting (PEC) body. We provide an analysis that supports the use of the TDLSM for this problem, and preliminary numerical tests of the algorithm. Our analysis relies on the Laplace transform approach previously used for the acoustic wave equation. This is the first application of the TDLSM in electromagnetism.
 [12] arXiv:2110.07486 [pdf, other]

Title: Robust monolithic solvers for the StokesDarcy problem with the Darcy equation in primal formSubjects: Numerical Analysis (math.NA)
We construct meshindependent and parameterrobust monolithic solvers for the coupled primal StokesDarcy problem. Three different formulations and their discretizations in terms of conforming and nonconforming finite element methods and finite volume methods are considered. In each case, robust preconditioners are derived using a unified theoretical framework. In particular, the suggested preconditioners utilize operators in fractional Sobolev spaces. Numerical experiments demonstrate the parameterrobustness of the proposed solvers.
Crosslists for Fri, 15 Oct 21
 [13] arXiv:2110.07034 (crosslist from cs.LG) [pdf, other]

Title: How Does Momentum Benefit Deep Neural Networks Architecture Design? A Few Case StudiesComments: 42 pages, 15 figures. arXiv admin note: text overlap with arXiv:2110.04840Subjects: Machine Learning (cs.LG); Dynamical Systems (math.DS); Numerical Analysis (math.NA)
We present and review an algorithmic and theoretical framework for improving neural network architecture design via momentum. As case studies, we consider how momentum can improve the architecture design for recurrent neural networks (RNNs), neural ordinary differential equations (ODEs), and transformers. We show that integrating momentum into neural network architectures has several remarkable theoretical and empirical benefits, including 1) integrating momentum into RNNs and neural ODEs can overcome the vanishing gradient issues in training RNNs and neural ODEs, resulting in effective learning longterm dependencies. 2) momentum in neural ODEs can reduce the stiffness of the ODE dynamics, which significantly enhances the computational efficiency in training and testing. 3) momentum can improve the efficiency and accuracy of transformers.
 [14] arXiv:2110.07217 (crosslist from physics.aoph) [pdf, other]

Title: Alpine Permafrost Modeling: On the influence of topography driven lateral fluxesComments: 20 pages (without appendix), 9 figuresSubjects: Atmospheric and Oceanic Physics (physics.aoph); Numerical Analysis (math.NA)
Alpine permafrost environments are highly vulnerable and sensitive to changes in regional and global climate trends. Thawing and degradation of permafrost has numerous adverse environmental, economic, and societal impacts. Mathematical modeling and numerical simulations provide powerful tools for predicting the degree of degradation and evolution of subsurface permafrost as a result of global warming. A particularly significant characteristic of alpine environments is the high variability in their topography and geomorphology which drives large lateral thermal and fluid fluxes. Additionally, harsh winds, extreme weather conditions, and various degrees of saturation have to be considered. The combination of large lateral fluxes and unsaturated ground makes alpine systems markedly different from Arctic permafrost environments and general geotechnical ground freezing applications, and therefore, alpine permafrost demands its own specialized modeling approaches. In this research work, we present a multiphysics permafrost model tailored to alpine regions. In particular, we resolve the icewater phase transitions, unsaturated conditions, and capillary actions, and account for the impact of the evolving pore volume on fluidmatrix interactions. Moreover, the approach is multidimensional, and therefore, inherently resolves fluxes along topographic gradients. Through numerical cases studies based on the elevation profiles of the two prominent peaks of the Zugspitze (DE) and the Matterhorn (CH), we show the strong influence of topography driven thermal and fluid fluxes on active layer dynamics and the distribution of permafrost.
 [15] arXiv:2110.07403 (crosslist from math.AG) [pdf, ps, other]

Title: A more direct and better variant of New QNewton's method Backtracking for m equations in m variablesAuthors: Tuyen Trung TruongComments: 6 pagesSubjects: Algebraic Geometry (math.AG); Complex Variables (math.CV); Dynamical Systems (math.DS); Numerical Analysis (math.NA); Optimization and Control (math.OC)
In this paper we propose a variant of New QNewton's method Backtracking (which is relevant to LevenbergMarquardt algorithm, but with the argumentation chosen by New QNewton's method idea for good theoretical guarantee, and with Backtracking line search added) for to use specifically with systems of m equations in m variables.
We fix $\delta _0=0 $ and $\delta _1=2$, and a number $0<\tau <1$. If $A$ is a square matrix, we denote by $minsp(A)=\min \{\lambda : $ $\lambda$ is an eigenvalue of $A\}$. Also, we denote by $A^{\intercal}$ the transpose of $A$.
Given $F:\mathbb{R}^m\rightarrow \mathbb{R}^m$ a $C^1$ function, we denote by $H(x)=JF(x)$ the Jacobian of $F$, and $f(x)=F(x)^2$. If $x\in \mathbb{R}^m$ is such that $F(x)\not= 0$, we define various :
$\delta (x)$ be the first element $\delta _j$ in $\{\delta _0,\delta _1\}$ so that $minsp(H(x)+\delta _jF(x)^{\tau } )\geq \min \{ F(x)^{\tau},1\}$;
$A(x)=H(x)^{\intercal}H(x)+\delta (x)F(x)^{\tau }Id$;
$w(x)=A(x)^{1}H(x)^{\intercal}F(x)$; (if $x$ is close to a nondegenerate zero of $F$, then $w(x)=H(x)^{1}F(x)$ the usual Newton's direction) Note: we can normalise $w(x)/\max \{w(x) ,1\}$ if needed
$\gamma (x)$ is chosen from Armijo's Backtracking line search: it is the largest number $\gamma$ among $\{1,1/2,(1/2)^2,\ldots \}$ so that: $f(x\gamma w(x))f(x)\leq \gamma <w(x),H(x)^{\intercal}F(x)>$;
The update rule of our method is $x\mapsto x\gamma (x)w(x)$.
Good theoretical guarantees are proven, in particular for systems of polynomial equations. In "generic situations", we will also discuss a way to avoid that the limit of the constructed sequence is a solution of $H(x)^{\intercal}F(x)=0$ but not of $F(x)=0$.  [16] arXiv:2110.07492 (crosslist from quantph) [pdf, other]

Title: A Theory of Quantum Subspace DiagonalizationComments: 42 pages, 13 figuresSubjects: Quantum Physics (quantph); Numerical Analysis (math.NA)
Quantum subspace diagonalization methods are an exciting new class of algorithms for solving large scale eigenvalue problems using quantum computers. Unfortunately, these methods require the solution of an illconditioned generalized eigenvalue problem, with a matrix pencil corrupted by a nonnegligible amount of noise that is far above the machine precision. Despite pessimistic predictions from classical perturbation theories, these methods can perform reliably well if the generalized eigenvalue problem is solved using a standard truncation strategy. We provide a theoretical analysis of this surprising phenomenon, proving that under certain natural conditions, a quantum subspace diagonalization algorithm can accurately compute the smallest eigenvalue of a large Hermitian matrix. We give numerical experiments demonstrating the effectiveness of the theory and providing practical guidance for the choice of truncation level.
Replacements for Fri, 15 Oct 21
 [17] arXiv:2005.12161 (replaced) [pdf, ps, other]

Title: Triangularized Orthogonalizationfree Method for Solving Extreme Eigenvalue ProblemsSubjects: Numerical Analysis (math.NA)
 [18] arXiv:2102.12778 (replaced) [pdf, other]

Title: Lie Group integrators for mechanical systemsComments: 35 pagesSubjects: Numerical Analysis (math.NA); Dynamical Systems (math.DS)
 [19] arXiv:2109.11436 (replaced) [pdf, ps, other]

Title: Piecewise PadéChebyshev Reconstruction of Bivariate Piecewise Smooth FunctionsAuthors: Akansha SinghComments: 26 pages, 15 figuresSubjects: Numerical Analysis (math.NA)
 [20] arXiv:2110.02665 (replaced) [pdf, ps, other]

Title: A structure preserving shiftinvert infinite Arnoldi algorithm for a class of delay eigenvalue problems with Hamiltonian symmetrySubjects: Numerical Analysis (math.NA)
 [21] arXiv:2002.08724 (replaced) [pdf, ps, other]

Title: Highresolution signal recovery via generalized sampling and functional principal component analysisAuthors: Milana GataricComments: Accepted for publication in Springer's Advances in Computational MathematicsSubjects: Statistics Theory (math.ST); Signal Processing (eess.SP); Numerical Analysis (math.NA); Machine Learning (stat.ML)
 [22] arXiv:2102.07833 (replaced) [pdf, other]

Title: QuasiMonte Carlo SoftwareAuthors: SouCheng T. Choi, Fred J. Hickernell, R. Jagadeeswaran, Michael J. McCourt, Aleksei G. SorokinComments: 25 pages, 7 figures, to be published in the MCQMC2020 ProceedingsSubjects: Mathematical Software (cs.MS); Numerical Analysis (math.NA)
 [23] arXiv:2107.12527 (replaced) [pdf, ps, other]

Title: PhysicsEnforced Modeling for Insertion Loss of Transmission Lines by Deep Neural NetworksSubjects: Machine Learning (cs.LG); Numerical Analysis (math.NA)
 [24] arXiv:2110.01601 (replaced) [pdf, other]

Title: NeuFENet: Neural Finite Element Solutions with Theoretical Bounds for Parametric PDEsAuthors: Biswajit Khara, Aditya Balu, Ameya Joshi, Soumik Sarkar, Chinmay Hegde, Adarsh Krishnamurthy, Baskar GanapathysubramanianSubjects: Machine Learning (cs.LG); Numerical Analysis (math.NA)
[ showing up to 2000 entries per page: fewer  more ]
Disable MathJax (What is MathJax?)
Links to: arXiv, form interface, find, cs, recent, 2110, contact, help (Access key information)