References & Citations
Computer Science > Computation and Language
Title: Hierarchical Curriculum Learning for AMR Parsing
(Submitted on 15 Oct 2021 (this version), latest version 26 Apr 2022 (v5))
Abstract: Abstract Meaning Representation (AMR) parsing translates sentences to the semantic representation with a hierarchical structure, which is recently empowered by pretrained encoder-decoder models. However, the flat sentence-to-AMR training paradigm impedes the representation learning of concepts and relations in the deeper AMR sub-graph. To make the sequence-to-sequence models better adapt to the inherent AMR structure, we propose a hierarchical curriculum learning (HCL) which consists of (1) structure-level curriculum (SC) and (2) instance-level curriculum (IC). SC switches progressively from shallow to deep AMR sub-graphs while IC transits from easy to hard AMR instances during training. Extensive experiments show that BART trained with HCL achieves the state-of-the-art performance on the AMR-2.0 and AMR-3.0 benchmark, and significantly outperforms baselines on the structure-dependent evaluation metrics and hard instances.
Submission history
From: Peiyi Wang [view email][v1] Fri, 15 Oct 2021 04:45:15 GMT (163kb,D)
[v2] Thu, 10 Mar 2022 15:44:31 GMT (545kb,D)
[v3] Sun, 3 Apr 2022 12:30:22 GMT (545kb,D)
[v4] Wed, 20 Apr 2022 14:03:12 GMT (572kb,D)
[v5] Tue, 26 Apr 2022 08:31:33 GMT (572kb,D)
Link back to: arXiv, form interface, contact.