Numerical Analysis
New submissions
[ showing up to 1000 entries per page: fewer | more ]
New submissions for Wed, 24 Apr 24
- [1] arXiv:2404.14592 [pdf, other]
-
Title: High-order Accurate Implicit-Explicit Time-Stepping Schemes for Wave Equations on Overset GridsSubjects: Numerical Analysis (math.NA)
New implicit and implicit-explicit time-stepping methods for the wave equation in second-order form are described with application to two and three-dimensional problems discretized on overset grids. The implicit schemes are single step, three levels in time, and based on the modified equation approach. Second and fourth-order accurate schemes are developed and they incorporate upwind dissipation for stability on overset grids. The fully implicit schemes are useful for certain applications such as the WaveHoltz algorithm for solving Helmholtz problems where very large time-steps are desired. Some wave propagation problems are geometrically stiff due to localized regions of small grid cells, such as grids needed to resolve fine geometric features, and for these situations the implicit time-stepping scheme is combined with an explicit scheme: the implicit scheme is used for component grids containing small cells while the explicit scheme is used on the other grids such as background Cartesian grids. The resulting partitioned implicit-explicit scheme can be many times faster than using an explicit scheme everywhere. The accuracy and stability of the schemes are studied through analysis and numerical computations.
- [2] arXiv:2404.14636 [pdf, other]
-
Title: An inexact augmented Lagrangian algorithm for unsymmetric saddle-point systemsSubjects: Numerical Analysis (math.NA); Data Structures and Algorithms (cs.DS)
Augmented Lagrangian (AL) methods are a well known class of algorithms for solving constrained optimization problems. They have been extended to the solution of saddle-point systems of linear equations. We study an AL (SPAL) algorithm for unsymmetric saddle-point systems and derive convergence and semi-convergence properties, even when the system is singular. At each step, our SPAL requires the exact solution of a linear system of the same size but with an SPD (2,2) block. To improve efficiency, we introduce an inexact SPAL algorithm. We establish its convergence properties under reasonable assumptions. Specifically, we use a gradient method, known as the Barzilai-Borwein (BB) method, to solve the linear system at each iteration. We call the result the augmented Lagrangian BB (SPALBB) algorithm and study its convergence. Numerical experiments on test problems from Navier-Stokes equations and coupled Stokes-Darcy flow show that SPALBB is more robust and efficient than BICGSTAB and GMRES. SPALBB often requires the least CPU time, especially on large systems.
- [3] arXiv:2404.14783 [pdf, ps, other]
-
Title: One-Pass Randomized Algorithm with Practical Rangefinder for Low-Rank Approximation to Quaternion MatricesComments: 32 pages, 18 figuresSubjects: Numerical Analysis (math.NA)
As its real/complex counterparts, randomized algorithms for low-rank approximation to quaternion matrices received attention recently. For large-scale problems, however, existing quaternion orthogonalization methods are not efficient, leading to slow rangefinders. By relaxing orthonormality while maintaining favaroable condition numbers, this work proposes two practical quaternion rangefinders that take advantage of mature scientific computing libraries to accelerate heavy computations. They are then incorporated into the quaternion version of a well-known one-pass algorithm. Theoretically, we establish the probabilistic error bound, and demonstrate that the error is proportional to the condition number of the rangefinder. Besides Gaussian, we also allow quaternion sub-Gaussian test matrices. Key to the latter is the derivation of a deviation bound for extreme singular values of a quaternion sub-Gaussian matrix. Numerical experiments indicate that the one-pass algorithm with the proposed rangefinders work efficiently while only sacrificing little accuracy. In addition, we tested the algorithm in an on-the-fly 3D Navier-Stokes equation data compression to demonstrate its efficiency in large-scale applications.
- [4] arXiv:2404.14842 [pdf, ps, other]
-
Title: Superiority of stochastic symplectic methods via the law of iterated logarithmSubjects: Numerical Analysis (math.NA); Probability (math.PR)
The superiority of stochastic symplectic methods over non-symplectic counterparts has been verified by plenty of numerical experiments, especially in capturing the asymptotic behaviour of the underlying solution process. How can one theoretically explain this superiority? This paper gives an answer to this problem from the perspective of the law of iterated logarithm, taking the linear stochastic Hamiltonian system in Hilbert space as a test model. The main contribution is twofold. First, by fully utilizing the time-change theorem for martingales and the Borell--TIS inequality, we prove that the upper limit of the exact solution with a specific scaling function almost surely equals some non-zero constant, thus confirming the validity of the law of iterated logarithm. Second, we prove that stochastic symplectic fully discrete methods asymptotically preserve the law of iterated logarithm, but non-symplectic ones do not. This reveals the good ability of stochastic symplectic methods in characterizing the almost sure asymptotic growth of the utmost fluctuation of the underlying solution process. Applications of our results to the linear stochastic oscillator and the linear stochastic Schrodinger equation are also presented.
- [5] arXiv:2404.14864 [pdf, ps, other]
-
Title: A GPU-accelerated Cartesian grid method is proposed for solving the heat, wave, and Schrodinger equations on irregular domainsComments: 40 pages,12 figuresSubjects: Numerical Analysis (math.NA); Mathematical Physics (math-ph)
This paper introduces a second-order method for solving general elliptic partial differential equations (PDEs) on irregular domains using GPU acceleration, based on Ying's kernel-free boundary integral (KFBI) method. The method addresses limitations imposed by CFL conditions in explicit schemes and accuracy issues in fully implicit schemes for the Laplacian operator. To overcome these challenges, the paper employs a series of second-order time discrete schemes and splits the Laplacian operator into explicit and implicit components. Specifically, the Crank-Nicolson method discretizes the heat equation in the temporal dimension, while the implicit scheme is used for the wave equation. The Schrodinger equation is treated using the Strang splitting method. By discretizing the temporal dimension implicitly, the heat, wave, and Schrodinger equations are transformed into a sequence of elliptic equations. The Laplacian operator on the right-hand side of the elliptic equation is obtained from the numerical scheme rather than being discretized and corrected by the five-point difference method. A Cartesian grid-based KFBI method is employed to solve the resulting elliptic equations. GPU acceleration, achieved through a parallel Cartesian grid solver, enhances the computational efficiency by exploiting high degrees of parallelism. Numerical results demonstrate that the proposed method achieves second-order accuracy for the heat, wave, and Schrodinger equations. Furthermore, the GPU-accelerated solvers for the three types of time-dependent equations exhibit a speedup of 30 times compared to CPU-based solvers.
- [6] arXiv:2404.14893 [pdf, other]
-
Title: Average energy dissipation rates of explicit exponential Runge-Kutta methods for gradient flow problemsComments: 35 pages, 44 figuresSubjects: Numerical Analysis (math.NA)
We propose a unified theoretical framework to examine the energy dissipation properties at all stages of explicit exponential Runge-Kutta (EERK) methods for gradient flow problems. The main part of the novel framework is to construct the differential form of EERK method by using the difference coefficients of method and the so-called discrete orthogonal convolution kernels. As the main result, we prove that an EERK method can preserve the original energy dissipation law unconditionally if the associated differentiation matrix is positive semi-definite. A simple indicator, namely average dissipation rate, is also introduced for these multi-stage methods to evaluate the overall energy dissipation rate of an EERK method such that one can choose proper parameters in some parameterized EERK methods or compare different kinds of EERK methods. Some existing EERK methods in the literature are evaluated from the perspective of preserving the original energy dissipation law and the energy dissipation rate. Some numerical examples are also included to support our theory.
- [7] arXiv:2404.14958 [pdf, ps, other]
-
Title: Saving proof-of-work by hierarchical block structureAuthors: Valdemar MelicherSubjects: Numerical Analysis (math.NA); Computational Engineering, Finance, and Science (cs.CE); Cryptography and Security (cs.CR); Computers and Society (cs.CY)
We argue that the current POW based consensus algorithm of the Bitcoin network suffers from a fundamental economic discrepancy between the real world transaction (txn) costs incurred by miners and the wealth that is being transacted. Put simply, whether one transacts 1 satoshi or 1 bitcoin, the same amount of electricity is needed when including this txn into a block. The notorious Bitcoin blockchain problems such as its high energy usage per txn or its scalability issues are, either partially or fully, mere consequences of this fundamental economic inconsistency. We propose making the computational cost of securing the txns proportional to the wealth being transferred, at least temporarily.
First, we present a simple incentive based model of Bitcoin's security. Then, guided by this model, we augment each txn by two parameters, one controlling the time spent securing this txn and the second determining the fraction of the network used to accomplish this. The current Bitcoin txns are naturally embedded into this parametrized space. Then we introduce a sequence of hierarchical block structures (HBSs) containing these parametrized txns. The first of those HBSs exploits only a single degree of freedom of the extended txn, namely the time investment, but it allows already for txns with a variable level of trust together with aligned network fees and energy usage. In principle, the last HBS should scale to tens of thousands timely txns per second while preserving what the previous HBSs achieved.
We also propose a simple homotopy based transition mechanism which enables us to relatively safely and continuously introduce new HBSs into the existing blockchain.
Our approach is constructive and as rigorous as possible and we attempt to analyze all aspects of these developments, al least at a conceptual level. The process is supported by evaluation on recent transaction data. - [8] arXiv:2404.15090 [pdf, ps, other]
-
Title: Galerkin-Bernstein Approximations for the System of Third-Order Nonlinear Boundary Value ProblemsSubjects: Numerical Analysis (math.NA)
This paper is devoted to find the numerical solutions of one dimensional general nonlinear system of third-order boundary value problems (BVPs) for the pair of functions using Galerkin weighted residual method. We derive mathematical formulations in matrix form, in details, by exploiting Bernstein polynomials as basis functions. A reasonable accuracy is found when the proposed method is used on few examples. At the end of the study, a comparison is made between the approximate and exact solutions, and also with the solutions of the existing methods. Our results converge monotonically to the exact solutions. In addition, we show that the the derived formulations may be applicable by reducing higher order complicated BVP into a lower order system of BVPs, and the performance of the numerical solutions is satisfactory.
- [9] arXiv:2404.15249 [pdf, ps, other]
-
Title: A GPU-accelerated Cartesian grid method for PDEs on irregular domainComments: 24pages 10figuresSubjects: Numerical Analysis (math.NA)
The kernel-free boundary integral (KFBI) method has successfully solved partial differential equations (PDEs) on irregular domains. Diverging from traditional boundary integral methods, the computation of boundary integrals in KFBI is executed through the resolution of equivalent simple interface problems on Cartesian grids, utilizing fast algorithms. While existing implementations of KFBI methods predominantly utilize CPU platforms, GPU architecture's superior computational capabilities and extensive memory bandwidth offer an efficient resolution to computational bottlenecks. This paper delineates the algorithms adapted for both single-GPU and multiple-GPU applications. On a single GPU, assigning individual threads can control correction, interpolation, and jump calculations. The algorithm is expanded to multiple GPUs to enhance the processing of larger-scale problems. The arrowhead decomposition method is employed in multiple-GPU settings, ensuring optimal computational efficiency and load balancing. Numerical examples show that the proposed algorithm is second-order accurate and efficient. Single-GPU solver speeds 50-200 times than traditional CPU while the eight GPUs distributed solver yields up to 60% parallel efficiency.
Cross-lists for Wed, 24 Apr 24
- [10] arXiv:2404.14456 (cross-list from cs.LG) [pdf, ps, other]
-
Title: Multifidelity Surrogate Models: A New Data Fusion PerspectiveAuthors: Daniel N WilkeComments: 8 pages, 4 figures, SACAM2024 Conference, 22-23 January 2024Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA)
Multifidelity surrogate modelling combines data of varying accuracy and cost from different sources. It strategically uses low-fidelity models for rapid evaluations, saving computational resources, and high-fidelity models for detailed refinement. It improves decision-making by addressing uncertainties and surpassing the limits of single-fidelity models, which either oversimplify or are computationally intensive. Blending high-fidelity data for detailed responses with frequent low-fidelity data for quick approximations facilitates design optimisation in various domains.
Despite progress in interpolation, regression, enhanced sampling, error estimation, variable fidelity, and data fusion techniques, challenges persist in selecting fidelity levels and developing efficient data fusion methods. This study proposes a new fusion approach to construct multi-fidelity surrogate models by constructing gradient-only surrogates that use only gradients to construct regression surfaces. Results are demonstrated on foundational example problems that isolate and illustrate the fusion approach's efficacy, avoiding the need for complex examples that obfuscate the main concept. - [11] arXiv:2404.14688 (cross-list from cs.LG) [pdf, other]
-
Title: FMint: Bridging Human Designed and Data Pretrained Models for Differential Equation Foundation ModelSubjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Dynamical Systems (math.DS); Numerical Analysis (math.NA)
Human-designed algorithms have long been fundamental in solving a variety of scientific and engineering challenges. Recently, data-driven deep learning methods have also risen to prominence, offering innovative solutions across numerous scientific fields. While traditional algorithms excel in capturing the core aspects of specific problems, they often lack the flexibility needed for varying problem conditions due to the absence of specific data. Conversely, while data-driven approaches utilize vast datasets, they frequently fall short in domain-specific knowledge. To bridge these gaps, we introduce \textbf{FMint} (Foundation Model based on Initialization), a generative pre-trained model that synergizes the precision of human-designed algorithms with the adaptability of data-driven methods. This model is specifically engineered for high-accuracy simulation of dynamical systems. Starting from initial trajectories provided by conventional methods, FMint quickly delivers highly accurate solutions. It incorporates in-context learning and has been pre-trained on a diverse corpus of 500,000 dynamical systems, showcasing exceptional generalization across a broad spectrum of real-world applications. By effectively combining algorithmic rigor with data-driven flexibility, FMint sets the stage for the next generation of scientific foundation models, tackling complex problems with both efficiency and high accuracy.
- [12] arXiv:2404.14854 (cross-list from nlin.PS) [pdf, other]
-
Title: Quenching of stable pulses in slow-fast excitable mediaAuthors: Christopher D. MarcotteComments: 16 pages, 11 figuresSubjects: Pattern Formation and Solitons (nlin.PS); Numerical Analysis (math.NA); Quantitative Methods (q-bio.QM)
We develop linear theory for the prediction of excitation wave quenching--the construction of minimal perturbations which return stable excitations to quiescence--for localized pulse solutions of models of excitable media. The theory requires accounting for an additional degree of freedom in the formulation of the linear theory, and a reconsideration of heuristics for choosing optimal reference states from their group representation. We compare the predictions made with the linear theory to direct numerical simulations across a family of perturbations and assess the accuracy of predictions for models with distinct stable excitation structures. We find that the theory achieves qualitative predictive power with only the effort of distinguishing a root from the asymptotic case, and achieves quantitative predictive power in many circumstances. Finally, we compare the computational cost of our prediction technique to other numerical methods for the determination of transitions in extended excitable systems.
- [13] arXiv:2404.14857 (cross-list from stat.AP) [pdf, other]
-
Title: Variational Bayesian surrogate modelling with application to robust design optimisationComments: 31 pages, 16 figuresSubjects: Applications (stat.AP); Numerical Analysis (math.NA); Machine Learning (stat.ML)
Surrogate models provide a quick-to-evaluate approximation to complex computational models and are essential for multi-query problems like design optimisation. The inputs of current computational models are usually high-dimensional and uncertain. We consider Bayesian inference for constructing statistical surrogates with input uncertainties and intrinsic dimensionality reduction. The surrogates are trained by fitting to data from prevalent deterministic computational models. The assumed prior probability density of the surrogate is a Gaussian process. We determine the respective posterior probability density and parameters of the posited statistical model using variational Bayes. The non-Gaussian posterior is approximated by a simpler trial density with free variational parameters and the discrepancy between them is measured using the Kullback-Leibler (KL) divergence. We employ the stochastic gradient method to compute the variational parameters and other statistical model parameters by minimising the KL divergence. We demonstrate the accuracy and versatility of the proposed reduced dimension variational Gaussian process (RDVGP) surrogate on illustrative and robust structural optimisation problems with cost functions depending on a weighted sum of the mean and standard deviation of model outputs.
- [14] arXiv:2404.14873 (cross-list from stat.ML) [pdf, ps, other]
-
Title: Estimating the Distribution of Parameters in Differential Equations with Repeated Cross-Sectional DataComments: 16 pages, 10 figuresSubjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Numerical Analysis (math.NA)
Differential equations are pivotal in modeling and understanding the dynamics of various systems, offering insights into their future states through parameter estimation fitted to time series data. In fields such as economy, politics, and biology, the observation data points in the time series are often independently obtained (i.e., Repeated Cross-Sectional (RCS) data). With RCS data, we found that traditional methods for parameter estimation in differential equations, such as using mean values of time trajectories or Gaussian Process-based trajectory generation, have limitations in estimating the shape of parameter distributions, often leading to a significant loss of data information. To address this issue, we introduce a novel method, Estimation of Parameter Distribution (EPD), providing accurate distribution of parameters without loss of data information. EPD operates in three main steps: generating synthetic time trajectories by randomly selecting observed values at each time point, estimating parameters of a differential equation that minimize the discrepancy between these trajectories and the true solution of the equation, and selecting the parameters depending on the scale of discrepancy. We then evaluated the performance of EPD across several models, including exponential growth, logistic population models, and target cell-limited models with delayed virus production, demonstrating its superiority in capturing the shape of parameter distributions. Furthermore, we applied EPD to real-world datasets, capturing various shapes of parameter distributions rather than a normal distribution. These results effectively address the heterogeneity within systems, marking a substantial progression in accurately modeling systems using RCS data.
- [15] arXiv:2404.15242 (cross-list from cs.LG) [pdf, other]
-
Title: A Hybrid Kernel-Free Boundary Integral Method with Operator Learning for Solving Parametric Partial Differential Equations In Complex DomainsComments: 30 pages,6 figuresSubjects: Machine Learning (cs.LG); Numerical Analysis (math.NA)
The Kernel-Free Boundary Integral (KFBI) method presents an iterative solution to boundary integral equations arising from elliptic partial differential equations (PDEs). This method effectively addresses elliptic PDEs on irregular domains, including the modified Helmholtz, Stokes, and elasticity equations. The rapid evolution of neural networks and deep learning has invigorated the exploration of numerical PDEs. An increasing interest is observed in deep learning approaches that seamlessly integrate mathematical principles for investigating numerical PDEs. We propose a hybrid KFBI method, integrating the foundational principles of the KFBI method with the capabilities of deep learning. This approach, within the framework of the boundary integral method, designs a network to approximate the solution operator for the corresponding integral equations by mapping the parameters, inhomogeneous terms and boundary information of PDEs to the boundary density functions, which can be regarded as the solution of the integral equations. The models are trained using data generated by the Cartesian grid-based KFBI algorithm, exhibiting robust generalization capabilities. It accurately predicts density functions across diverse boundary conditions and parameters within the same class of equations. Experimental results demonstrate that the trained model can directly infer the boundary density function with satisfactory precision, obviating the need for iterative steps in solving boundary integral equations. Furthermore, applying the inference results of the model as initial values for iterations is also reasonable; this approach can retain the inherent second-order accuracy of the KFBI method while accelerating the traditional KFBI approach by reducing about 50% iterations.
Replacements for Wed, 24 Apr 24
- [16] arXiv:2208.09095 (replaced) [pdf, other]
-
Title: Estimating and using information in inverse problemsSubjects: Numerical Analysis (math.NA); Information Theory (cs.IT); Analysis of PDEs (math.AP)
- [17] arXiv:2303.10687 (replaced) [pdf, other]
-
Title: Error analysis for a Crouzeix-Raviart approximation of the variable exponent Dirichlet problemComments: 30 pages, 4 tables, this article extends the methods in arXiv:2210.12116 to the variable exponent settingSubjects: Numerical Analysis (math.NA)
- [18] arXiv:2303.12473 (replaced) [pdf, ps, other]
-
Title: Accelerating iterative solvers via a two-dimensional minimum residual techniqueSubjects: Numerical Analysis (math.NA)
- [19] arXiv:2305.14319 (replaced) [pdf, other]
-
Title: On the convergence of Fourier spectral methods involving non-compact operatorsAuthors: Thomas TrogdonSubjects: Numerical Analysis (math.NA); Functional Analysis (math.FA); Spectral Theory (math.SP)
- [20] arXiv:2309.02877 (replaced) [pdf, ps, other]
-
Title: A multilinear Nyström algorithm for low-rank approximation of tensors in Tucker formatSubjects: Numerical Analysis (math.NA)
- [21] arXiv:2309.09061 (replaced) [pdf, other]
-
Title: Adaptive multiplication of rank-structured matrices in linear complexityAuthors: Steffen BörmSubjects: Numerical Analysis (math.NA)
- [22] arXiv:2401.15608 (replaced) [pdf, ps, other]
-
Title: The stochastic fractional nonlinear Schrödinger equations in $H^α$ and structure-preserving algorithmSubjects: Numerical Analysis (math.NA); Analysis of PDEs (math.AP)
- [23] arXiv:2402.00737 (replaced) [pdf, other]
-
Title: Localization of point scatterers via sparse optimization on measuresSubjects: Numerical Analysis (math.NA)
- [24] arXiv:2404.03045 (replaced) [pdf, other]
-
Title: Analysis of a VEM-fully discrete polytopal scheme with bubble stabilisation for contact mechanics with Tresca frictionSubjects: Numerical Analysis (math.NA)
- [25] arXiv:2404.08823 (replaced) [pdf, other]
-
Title: Solving high-dimensional Kolmogorov backward equations with functional hierarchical tensor operatorsSubjects: Numerical Analysis (math.NA)
- [26] arXiv:2211.14525 (replaced) [pdf, ps, other]
-
Title: Calculus rules for proximal ε-subdifferentials and inexact proximity operators for weakly convex functionsSubjects: Optimization and Control (math.OC); Numerical Analysis (math.NA)
- [27] arXiv:2306.13405 (replaced) [pdf, ps, other]
-
Title: New asymptotic expansion formula via Malliavin calculus and its application to rough differential equation driven by fractional Brownian motionComments: 19 pages, 1 figure, revised versionSubjects: Probability (math.PR); Numerical Analysis (math.NA)
- [28] arXiv:2311.00259 (replaced) [pdf, other]
-
Title: Solutions to Elliptic and Parabolic Problems via Finite Difference Based Unsupervised Small Linear Convolutional Neural NetworksComments: Submitted to CMA, under reviewSubjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Numerical Analysis (math.NA)
- [29] arXiv:2401.04823 (replaced) [pdf, other]
-
Title: Deep learning surrogate for predicting hydraulic conductivity tensors from stochastic discrete fracture-matrix modelsComments: 23 pages, 10 figures, to be published in Computers & GeosciencesSubjects: Analysis of PDEs (math.AP); Numerical Analysis (math.NA)
[ showing up to 1000 entries per page: fewer | more ]
Disable MathJax (What is MathJax?)
Links to: arXiv, form interface, find, cs, recent, 2404, contact, help (Access key information)