We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Injecting Numerical Reasoning Skills into Knowledge Base Question Answering Models

Abstract: Embedding-based methods are popular for Knowledge Base Question Answering (KBQA), but few current models have numerical reasoning skills and thus struggle to answer ordinal constrained questions. This paper proposes a new embedding-based KBQA framework which particularly takes numerical reasoning into account. We present NumericalTransformer on top of NSM, a state-of-the-art embedding-based KBQA model, to create NT-NSM. To enable better training, we propose two pre-training tasks with explicit numerical-oriented loss functions on two generated training datasets and a template-based data augmentation method for enriching ordinal constrained QA dataset. Extensive experiments on KBQA benchmarks demonstrate that with the help of our training algorithm, NT-NSM is empowered with numerical reasoning skills and substantially outperforms the baselines in answering ordinal constrained questions.
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2112.06109 [cs.CL]
  (or arXiv:2112.06109v2 [cs.CL] for this version)

Submission history

From: Yu Feng [view email]
[v1] Sun, 12 Dec 2021 01:30:29 GMT (768kb,D)
[v2] Mon, 16 May 2022 04:37:47 GMT (960kb,D)

Link back to: arXiv, form interface, contact.