# Numerical Analysis

## New submissions

[ total of 21 entries: 1-21 ]
[ showing up to 250 entries per page: fewer | more ]

### New submissions for Fri, 27 May 22


Title: Diagonally implicit Runge-Kutta schemes: Discrete energy-balance laws and compactness properties
Subjects: Numerical Analysis (math.NA)

We study diagonally implicit Runge-Kutta (DIRK) schemes when applied to abstract evolution problems that fit into the Gelfand-triple framework. We introduce novel stability notions that are well-suited to this setting and provide simple, necessary and sufficient, conditions to verify that a DIRK scheme is stable in our sense and in Bochner-type norms. We use several popular DIRK schemes in order to illustrate cases that satisfy the required structural stability properties and cases that do not. In addition, under some mild structural conditions on the problem we can guarantee compactness of families of discrete solutions with respect to time discretization.


Title: A Stable Weighted Residual Finite Element Formulation for the Simulation of Linear Moving Conductor Problems
Subjects: Numerical Analysis (math.NA)

The finite element method is one of the widely employed numerical techniques in electrical engineering for the study of electric and magnetic fields. When applied to the moving conductor problems, the finite element method is known to have numerical oscillations in the solution. To resolve this, the upwinding techniques, which are developed for the transport equation are borrowed and directly employed for the magnetic induction equation. In this work, an alternative weighted residual formulation is explored for the simulation of the linear moving conductor problems. The stability of the formulation is analytically studied for the 1D version of the moving conductor problem. Then the rate of convergence and the accuracy are illustrated with the help of several test cases in 1D as well as 2D. Subsequently, the stability of the formulation is demonstrated with a 3D moving conductor simulation.


Title: Cost-efficient Gaussian Tensor Network Embeddings for Tensor-structured Inputs
Subjects: Numerical Analysis (math.NA); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG)

This work discusses tensor network embeddings, which are random matrices ($S$) with tensor network structure. These embeddings have been used to perform dimensionality reduction of tensor network structured inputs $x$ and accelerate applications such as tensor decomposition and kernel regression. Existing works have designed embeddings for inputs $x$ with specific structures, such that the computational cost for calculating $Sx$ is efficient. We provide a systematic way to design tensor network embeddings consisting of Gaussian random tensors, such that for inputs with more general tensor network structures, both the sketch size (row size of $S$) and the sketching computational cost are low.
We analyze general tensor network embeddings that can be reduced to a sequence of sketching matrices. We provide a sufficient condition to quantify the accuracy of such embeddings and derive sketching asymptotic cost lower bounds using embeddings that satisfy this condition and have a sketch size lower than any input dimension. We then provide an algorithm to efficiently sketch input data using such embeddings. The sketch size of the embedding used in the algorithm has a linear dependence on the number of sketching dimensions of the input. Assuming tensor contractions are performed with classical dense matrix multiplication algorithms, this algorithm achieves asymptotic cost within a factor of $O(\sqrt{m})$ of our cost lower bound, where $m$ is the sketch size. Further, when each tensor in the input has a dimension that needs to be sketched, this algorithm yields the optimal sketching asymptotic cost. We apply our sketching analysis to inexact tensor decomposition optimization algorithms. We provide a sketching algorithm for CP decomposition that is asymptotically faster than existing work in multiple regimes, and show optimality of an existing algorithm for tensor train rounding.


Title: An Acceleration of Fixed Point Iterations for M/G/1-type Markov Chains by Means of Relaxation Techniques
Subjects: Numerical Analysis (math.NA)

We present some accelerated variants of fixed point iterations for computing the minimal non-negative solution of the unilateral matrix equation associated with an M/G/1-type Markov chain. These schemes derive from certain staircase regular splittings of the block Hessenberg M-matrix associated with the Markov chain. By exploiting the staircase profile we introduce a two-step fixed point iteration. The iteration can be further accelerated by computing a weighted average between the approximations obtained in two consecutive steps. The convergence of the basic two-step fixed point iteration and of its relaxed modification is proved. Our theoretical analysis along with several numerical experiments show that the proposed variants generally outperform the classical iterations.


Title: Projectively and weakly simultaneously diagonalizable matrices and their applications
Subjects: Numerical Analysis (math.NA)

Characterizing simultaneously diagonalizable (SD) matrices has been receiving considerable attention in the recent decades due to its wide applications and its role in matrix analysis. However, the notion of SD matrices is arguably still restrictive for wider applications. In this paper, we consider two error measures related to the simultaneous diagonalization of matrices, and propose several new variants of SD thereof; in particular, TWSD, TWSD-B, T_{m,n}-SD (SDO), DWSD and D_{m,n}-SD (SDO). Those are all weaker forms of SD. We derive various sufficient and/or necessary conditions of them under different assumptions, and show the relationships between these new notions. Finally, we discuss the applications of these new notions in, e.g., quadratically constrained quadratic programming (QCQP) and independent component analysis (ICA).


Title: A DPG method for Reissner-Mindlin plates
Subjects: Numerical Analysis (math.NA)

We present a discontinuous Petrov-Galerkin (DPG) method with optimal test functions for the Reissner-Mindlin plate bending model. Our method is based on a variational formulation that utilizes a Helmholtz decomposition of the shear force. It produces approximations of the primitive variables and the bending moments. For any canonical selection of boundary conditions the method converges quasi-optimally. In the case of hard-clamped convex plates, we prove that the lowest-order scheme is locking free. Several numerical experiments confirm our results.


Title: Arbitrary High Order WENO Finite Volume Scheme with Flux Globalization for Moving Equilibria Preservation
Subjects: Numerical Analysis (math.NA)

In the context of preserving stationary states, e.g. lake at rest and moving equilibria, a new formulation of the shallow water system, called Flux Globalization has been introduced by Cheng et al. (2019). This approach consists in including the integral of the source term in the global flux and reconstructing the new global flux rather than the conservative variables. The resulting scheme is able to preserve a large family of smooth and discontinuous steady state moving equilibria. In this work, we focus on an arbitrary high order WENO Finite Volume (FV) generalization of the global flux approach. The most delicate aspect of the algorithm is the appropriate definition of the source flux (integral of the source term) and the quadrature strategy used to match it with the WENO reconstruction of the hyperbolic flux. When this construction is correctly done, one can show that the resulting WENO FV scheme admits exact discrete steady states characterized by constant global fluxes. We also show that, by an appropriate quadrature strategy for the source, we can embed exactly some particular steady states, e.g. the lake at rest for the shallow water equations. It can be shown that an exact approximation of global fluxes leads to a scheme with better convergence properties and improved solutions. The novel method has been tested and validated on classical cases: subcritical, supercritical and transcritical flows.


Title: On the interface matrix for fluid-structure interaction problems with fictitious domain approach
Subjects: Numerical Analysis (math.NA)

We study a recent formulation for fluid-structure interaction problems based on the use of a distributed Lagrange multiplier in the spirit of the fictitious domain approach. In this paper, we focus our attention on a crucial computational aspect regarding the interface matrix for the finite element discretization: it involves integration of functions supported on two different meshes. Several numerical tests show that accurate computation of the interface matrix has to be performed in order to ensure the optimal convergence of the method.


Title: Single-pass Nyström approximation in mixed precision
Subjects: Numerical Analysis (math.NA)

Low rank matrix approximations appear in a number of scientific computing applications. We consider the Nystr\"{o}m method for approximating a positive semidefinite matrix $A$. The computational cost of its single-pass version can be decreased by running it in mixed precision, where the expensive products with $A$ are computed in a lower than the working precision. We bound the extra finite precision error which is compared to the error of the Nystr\"{o}m approximation in exact arithmetic and identify when the approximation quality is not affected by the low precision computations. The mixed precision Nystr\"{o}m method can be used to inexpensively construct a limited memory preconditioner for the conjugate gradient method. We bound the condition number of the preconditioned coefficient matrix, and experimentally show that such preconditioner can be effective.


Title: Automatic parameter selection for the TGV regularizer in image restoration under Poisson noise
Subjects: Numerical Analysis (math.NA)

We address the image restoration problem under Poisson noise corruption. The Kullback-Leibler divergence, which is typically adopted in the variational framework as data fidelity term in this case, is coupled with the second-order Total Generalized Variation (TGV$^2$). The TGV$^2$ regularizer is known to be capable of preserving both smooth and piece-wise constant features in the image, however its behavior is subject to a suitable setting of the parameters arising in its expression. We propose a hierarchical Bayesian formulation of the original problem coupled with a Maximum A Posteriori estimation approach, according to which the unknown image and parameters can be jointly and automatically estimated by minimizing a given cost functional. The minimization problem is tackled via a scheme based on the Alternating Direction Method of Multipliers, which also incorporates a procedure for the automatic selection of the regularization parameter by means of a popular discrepancy principle. Computational results show the effectiveness of our proposal.


Title: Probabilistic failure mechanisms via Monte Carlo simulations of complex microstructures
Subjects: Numerical Analysis (math.NA)

A probabilistic approach to phase-field brittle and ductile fracture with random material and geometric properties is proposed within this work. In the macroscopic failure mechanics, materials properties and exactness of spatial quantities (of different phases in the geometrical domain) are assumed to be homogeneous and deterministic. This is unlike the lower-scale with strong fluctuation in the material and geometrical properties. Such a response is approximated through some uncertainty in the model problem. The presented contribution is devoted to providing a mathematical framework for modeling uncertainty through stochastic analysis of a microstructure undergoing brittle/ductile failure. Hereby, the proposed model employs various representative volume elements with random distribution of stiff-inclusions and voids within the composite structure. We develop an allocating strategy to allocate the heterogeneities and generate the corresponding meshes in two- and three-dimensional cases. Then the Monte Carlo finite element technique is employed for solving the stochastic PDE-based model and approximate the expectation and the variance of the solution field of brittle/ductile failure by evaluating a large number of samples. For the prediction of failure mechanisms, we rely on the phase-field approach which is a widely adopted framework for modeling and computing the fracture phenomena in solids. Incremental perturbed minimization principles for a class of gradient-type dissipative materials are used to derive the perturbed governing equations. This analysis enables us to study the highly heterogeneous microstructure and monitor the uncertainty in failure mechanics. Several numerical examples are given to examine the efficiency of the proposed method.

### Cross-lists for Fri, 27 May 22

  arXiv:2205.13055 (cross-list from math.OC) [pdf, other]
Title: Complexity-Optimal and Curvature-Free First-Order Methods for Finding Stationary Points of Composite Optimization Problems
Authors: Weiwei Kong
Subjects: Optimization and Control (math.OC); Computational Complexity (cs.CC); Numerical Analysis (math.NA)

This paper develops and analyzes an accelerated proximal descent method for finding stationary points of nonconvex composite optimization problems. The objective function is of the form $f+h$ where $h$ is a proper closed convex function, $f$ is a differentiable function on the domain of $h$, and $\nabla f$ is Lipschitz continuous on the domain of $h$. The main advantage of this method is that it is "curvature-free" in the sense that it does not require knowledge of the Lipschitz constant of $\nabla f$ or of any global topological properties of $f$. It is shown that the proposed method can obtain a $\rho$-approximate stationary point with iteration complexity bounds that are optimal, up to logarithmic terms over $\rho$, in both the convex and nonconvex settings. Some discussion is also given about how the proposed method can be leveraged in other existing optimization frameworks, such as min-max smoothing and penalty frameworks for constrained programming, to create more specialized curvature-free methods. Finally, numerical experiments on a set of nonconvex quadratic semidefinite programming problems are given to support the practical viability of the method.

### Replacements for Fri, 27 May 22

  arXiv:2012.00278 (replaced) [pdf, other]
Title: Convergence analysis of a fully discrete energy-stable numerical scheme for the Q-tensor flow of liquid crystals
Subjects: Numerical Analysis (math.NA); Analysis of PDEs (math.AP)
  arXiv:2108.02848 (replaced) [pdf, ps, other]
Title: Construction and application of provable positive and exact cubature formulas
Authors: Jan Glaubitz
Subjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)
  arXiv:2109.12485 (replaced) [pdf, other]
Title: On the convergence to local limit of nonlocal models with approximated interaction neighborhoods
Subjects: Numerical Analysis (math.NA)
  arXiv:2111.13401 (replaced) [pdf, other]
Title: A Learned-SVD approach for Regularization in Diffuse Optical Tomography
Subjects: Numerical Analysis (math.NA)
  arXiv:2202.00762 (replaced) [pdf, other]
Title: Extending FEniCS to Work in Higher Dimensions Using Tensor Product Finite Elements
Subjects: Numerical Analysis (math.NA); Mathematical Software (cs.MS)
  arXiv:2202.06775 (replaced) [pdf, other]
Title: A structure-preserving finite element approximation of surface diffusion for curve networks and surface clusters
Subjects: Numerical Analysis (math.NA); Computational Physics (physics.comp-ph)
  arXiv:2203.10477 (replaced) [pdf, other]
Title: A Non-iterative Overlapping Schwarz Waveform Relaxation Algorithm for Wave Equation
Authors: Fei Wei, Anna Zhao
Comments: 12 pages, 4 figures, submitted
Subjects: Numerical Analysis (math.NA)
  arXiv:2205.04262 (replaced) [pdf, other]
Title: Discontinuous Galerkin approximation of the fully-coupled thermo-poroelastic problem
Subjects: Numerical Analysis (math.NA)
  arXiv:2202.00645 (replaced) [pdf, other]
Title: Generalization Analysis of Message Passing Neural Networks on Large Random Graphs