We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Learning Constraints for Structured Prediction Using Rectifier Networks

Abstract: Various natural language processing tasks are structured prediction problems where outputs are constructed with multiple interdependent decisions. Past work has shown that domain knowledge, framed as constraints over the output space, can help improve predictive accuracy. However, designing good constraints often relies on domain expertise. In this paper, we study the problem of learning such constraints. We frame the problem as that of training a two-layer rectifier network to identify valid structures or substructures, and show a construction for converting a trained network into a system of linear constraints over the inference variables. Our experiments on several NLP tasks show that the learned constraints can improve the prediction accuracy, especially when the number of training examples is small.
Comments: to be published in ACL 2020
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)
ACM classes: I.2.6; I.2.7
Cite as: arXiv:2006.01209 [cs.CL]
  (or arXiv:2006.01209v1 [cs.CL] for this version)

Submission history

From: Xingyuan Pan [view email]
[v1] Sat, 23 May 2020 18:31:30 GMT (59kb)

Link back to: arXiv, form interface, contact.