We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Editing Language Model-based Knowledge Graph Embeddings

Abstract: Recently decades have witnessed the empirical success of framing Knowledge Graph (KG) embeddings via language models. However, language model-based KG embeddings are usually deployed as static artifacts, which are challenging to modify without re-training after deployment. To address this issue, we propose a new task of editing language model-based KG embeddings in this paper. The proposed task aims to enable data-efficient and fast updates to KG embeddings without damaging the performance of the rest. We build four new datasets: E-FB15k237, A-FB15k237, E-WN18RR, and A-WN18RR, and evaluate several knowledge editing baselines demonstrating the limited ability of previous models to handle the proposed challenging task. We further propose a simple yet strong baseline dubbed KGEditor, which utilizes additional parametric layers of the hyper network to edit/add facts. Comprehensive experimental results demonstrate that KGEditor can perform better when updating specific facts while not affecting the rest with low training resources. Code and datasets will be available in this https URL
Comments: Work in progress and the project website is this https URL
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB); Information Retrieval (cs.IR); Machine Learning (cs.LG)
Cite as: arXiv:2301.10405 [cs.CL]
  (or arXiv:2301.10405v4 [cs.CL] for this version)

Submission history

From: Ningyu Zhang [view email]
[v1] Wed, 25 Jan 2023 04:45:06 GMT (1036kb,D)
[v2] Mon, 6 Feb 2023 09:10:32 GMT (1036kb,D)
[v3] Mon, 13 Feb 2023 13:16:56 GMT (1036kb,D)
[v4] Sat, 25 Mar 2023 12:44:35 GMT (1037kb,D)

Link back to: arXiv, form interface, contact.