We gratefully acknowledge support from
the Simons Foundation and member institutions.

Numerical Analysis

New submissions

[ total of 15 entries: 1-15 ]
[ showing up to 50 entries per page: fewer | more ]

New submissions for Fri, 19 Aug 22

[1]  arXiv:2208.08500 [pdf, other]
Title: Translation invariant diagonal frame decomposition of inverse problems and their regularization
Subjects: Numerical Analysis (math.NA)

Solving inverse problems is central to a variety of important applications, such as biomedical image reconstruction and non-destructive testing. These problems are characterized by the sensitivity of direct solution methods with respect to data perturbations. To stabilize the reconstruction process, regularization methods have to be employed. Well-known regularization methods are based on frame expansions, such as the wavelet-vaguelette (WVD) decomposition, which are well adapted to the underlying signal class and the forward model and allow efficient implementation. However, it is well known that the lack of translational invariance of wavelets and related systems leads to specific artifacts in the reconstruction. To overcome this problem, in this paper we introduce and analyze the concept of translation invariant diagonal frame decomposition (TI-DFD) of linear operators. We prove that a TI-DFD combined with a regularizing filter leads to a convergent regularization method with optimal convergence rates. As illustrative example, we construct a wavelet-based TI-DFD for one-dimensional integration, where we also investigate our approach numerically. The results indicate that filtered TI-DFDs eliminate the typical wavelet artifacts when using standard wavelets and provide a fast, accurate, and stable solution scheme for inverse problems.

[2]  arXiv:2208.08538 [pdf, other]
Title: Stability and conditioning of immersed finite element methods: analysis and remedies
Subjects: Numerical Analysis (math.NA)

This review paper discusses the developments in immersed or unfitted finite element methods over the past decade. The main focus is the analysis and the treatment of the adverse effects of small cut elements. We distinguish between adverse effects regarding the stability and adverse effects regarding the conditioning of the system, and we present an overview of the developed remedies. In particular, we provide a detailed explanation of Schwarz preconditioning, element aggregation, and the ghost penalty formulation. Furthermore, we outline the methodologies developed for quadrature and weak enforcement of Dirichlet conditions, and we discuss open questions and future research directions.

[3]  arXiv:2208.08594 [pdf, other]
Title: An Improved Multi-Stage Preconditioner on GPUs for Compositional Reservoir Simulation
Comments: 24 pages, 4 figures, and 8 tables
Subjects: Numerical Analysis (math.NA)

The compositional model is often used to describe multicomponent multiphase porous media flows in the petroleum industry. The fully implicit method with strong stability and weak constraints on time-step sizes is commonly used in the mainstream commercial reservoir simulators. In this paper, we develop an efficient multi-stage preconditioner for the fully implicit compositional flow simulation. The method employs an adaptive setup phase to improve the parallel efficiency on GPUs. Furthermore, a multi-color Gauss-Seidel algorithm based on the adjacency matrix is applied in the algebraic multigrid methods for the pressure part. Numerical results demonstrate that the proposed algorithm achieves good parallel speedup while yields the same convergence behavior as the corresponding sequential version.

[4]  arXiv:2208.08635 [pdf, other]
Title: Physics-Informed Neural Network Method for Parabolic Differential Equations with Sharply Perturbed Initial Conditions
Subjects: Numerical Analysis (math.NA); Machine Learning (cs.LG)

In this paper, we develop a physics-informed neural network (PINN) model for parabolic problems with a sharply perturbed initial condition. As an example of a parabolic problem, we consider the advection-dispersion equation (ADE) with a point (Gaussian) source initial condition. In the $d$-dimensional ADE, perturbations in the initial condition decay with time $t$ as $t^{-d/2}$, which can cause a large approximation error in the PINN solution. Localized large gradients in the ADE solution make the (common in PINN) Latin hypercube sampling of the equation's residual highly inefficient. Finally, the PINN solution of parabolic equations is sensitive to the choice of weights in the loss function. We propose a normalized form of ADE where the initial perturbation of the solution does not decrease in amplitude and demonstrate that this normalization significantly reduces the PINN approximation error. We propose criteria for weights in the loss function that produce a more accurate PINN solution than those obtained with the weights selected via other methods. Finally, we proposed an adaptive sampling scheme that significantly reduces the PINN solution error for the same number of the sampling (residual) points. We demonstrate the accuracy of the proposed PINN model for forward, inverse, and backward ADEs.

[5]  arXiv:2208.08685 [pdf, other]
Title: A posteriori error estimates for discontinuous Galerkin methods on polygonal and polyhedral meshes
Subjects: Numerical Analysis (math.NA)

We present a new residual-type energy-norm a posteriori error analysis for interior penalty discontinuous Galerkin (dG) methods for linear elliptic problems. The new error bounds are also applicable to dG methods on meshes consisting of elements with very general polygonal/polyhedral shapes. The case of simplicial and/or box-type elements is included in the analysis as a special case. In particular, for the upper bounds, an arbitrary number of very small faces are allowed on each polygonal/polyhedral element, as long as certain mild shape regularity assumptions are satisfied. As a corollary, the present analysis generalizes known a posteriori error bounds for dG methods, allowing in particular for meshes with an arbitrary number of irregular hanging nodes per element. The proof hinges on a new conforming recovery strategy in conjunction with a Helmholtz decomposition formula. The resulting a posteriori error bound involves jumps on the tangential derivatives along elemental faces. Local lower bounds are also proven for a number of practical cases. Numerical experiments are also presented, highlighting the practical value of the derived a posteriori error bounds as error estimators.

[6]  arXiv:2208.08717 [pdf, other]
Title: Acoustic modal analysis with heat release fluctuations using nonlinear eigensolvers
Subjects: Numerical Analysis (math.NA)

Closed combustion devices like gas turbines and rockets are prone to thermoacoustic instabilities. Design engineers in the industry need tools to accurately identify and remove instabilities early in the design cycle. Many different approaches have been developed by the researchers over the years. In this work we focus on the Helmholtz wave equation based solver which is found to be relatively fast and accurate for most applications. This solver has been a subject of study in many previous works. The Helmholtz wave equation in frequency space reduces to a nonlinear eigenvalue problem which needs to be solved to compute the acoustic modes. Most previous implementations of this solver have relied on linearized solvers and iterative methods which as shown in this work are not very efficient and sometimes inaccurate. In this work we make use of specialized algorithms implemented in SLEPc that are accurate and efficient for computing eigenvalues of nonlinear eigenvalue problems. We make use of the n-tau model to compute the reacting source terms in the Helmholtz equation and describe the steps involved in deriving the Helmholtz eigenvalue equation and obtaining its solution using the SLEPc library.

[7]  arXiv:2208.08978 [pdf, other]
Title: A framework for implementing general virtual element spaces
Comments: 27 pages, 3 figures
Subjects: Numerical Analysis (math.NA)

In this paper we develop a framework for the construction and implementation of general virtual element spaces based on projections built from constraint least squares problems. We introduce the concept of a VEM tuple which encodes all the necessary building blocks to formulate the projections. Using this generic approach we present a wide range of virtual element spaces with additional properties. We showcase this approach with examples and build $H^k$-conforming spaces for $k=1,2$ as well as divergence and curl free spaces. The framework has the advantage of being easily integrated into any existing finite element package and we demonstrate this within the DUNE framework.

Cross-lists for Fri, 19 Aug 22

[8]  arXiv:2208.08626 (cross-list from stat.ML) [pdf, other]
Title: CP-PINNs: Changepoints Detection in PDEs using Physics Informed Neural Networks with Total-Variation Penalty
Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Dynamical Systems (math.DS); Numerical Analysis (math.NA)

We consider the inverse problem for the Partial Differential Equations (PDEs) such that the parameters of the dependency structure can exhibit random changepoints over time. This can arise, for example, when the physical system is either under malicious attack (e.g., hacker attacks on power grids and internet networks) or subject to extreme external conditions (e.g., weather conditions impacting electricity grids or large market movements impacting valuations of derivative contracts). For that purpose, we employ Physics Informed Neural Networks (PINNs) -- universal approximators that can incorporate prior information from any physical law described by a system of PDEs. This prior knowledge acts in the training of the neural network as a regularization that limits the space of admissible solutions and increases the correctness of the function approximation. We show that when the true data generating process exhibits changepoints in the PDE dynamics, this regularization can lead to a complete miss-calibration and a failure of the model. Therefore, we propose an extension of PINNs using a Total-Variation penalty which accommodates (multiple) changepoints in the PDE dynamics. These changepoints can occur at random locations over time, and they are estimated together with the solutions. We propose an additional refinement algorithm that combines changepoints detection with a reduced dynamic programming method that is feasible for the computationally intensive PINNs methods, and we demonstrate the benefits of the proposed model empirically using examples of different equations with changes in the parameters. In case of no changepoints in the data, the proposed model reduces to the original PINNs model. In the presence of changepoints, it leads to improvements in parameter estimation, better model fitting, and a lower training error compared to the original PINNs model.

Replacements for Fri, 19 Aug 22

[9]  arXiv:2011.08937 (replaced) [pdf, other]
Title: A C0 Interior Penalty Method for the Phase Field Crystal Equation
Comments: 30 pages, 2 figures, 1 table
Subjects: Numerical Analysis (math.NA)
[10]  arXiv:2108.03652 (replaced) [pdf, other]
Title: Non-self adjoint impedance in Generalized Optimized Schwarz Methods
Authors: Xavier Claeys
Subjects: Numerical Analysis (math.NA)
[11]  arXiv:2108.12921 (replaced) [pdf, other]
Title: Efficient computation of the zeros of the Bargmann transform under additive white noise
Subjects: Numerical Analysis (math.NA); Probability (math.PR)
[12]  arXiv:2010.07547 (replaced) [pdf, ps, other]
Title: Solving Trust Region Subproblems Using Riemannian Optimization
Subjects: Optimization and Control (math.OC); Numerical Analysis (math.NA)
[13]  arXiv:2105.02095 (replaced) [pdf, other]
Title: Two-layer neural networks with values in a Banach space
Authors: Yury Korolev
Subjects: Machine Learning (cs.LG); Functional Analysis (math.FA); Numerical Analysis (math.NA); Probability (math.PR)
[14]  arXiv:2112.05258 (replaced) [pdf, other]
Title: Direct 0D-3D coupling of a lattice Boltzmann methodology for fluid-structure hemodynamics simulations
Subjects: Fluid Dynamics (physics.flu-dyn); Numerical Analysis (math.NA)
[15]  arXiv:2207.03512 (replaced) [pdf, ps, other]
Title: The effect of smooth parametrizations on nonconvex optimization landscapes
Comments: Improved the abstract and added a few clarifications in the paper
Subjects: Optimization and Control (math.OC); Numerical Analysis (math.NA)
[ total of 15 entries: 1-15 ]
[ showing up to 50 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, cs, recent, 2208, contact, help  (Access key information)