Current browse context:
cs.CL
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Double Equivariance for Inductive Link Prediction for Both New Nodes and New Relation Types
(Submitted on 2 Feb 2023 (v1), last revised 14 Dec 2023 (this version, v7))
Abstract: The task of inductive link prediction in knowledge graphs (KGs) generally focuses on test predictions with solely new nodes but not both new nodes and new relation types. In this work, we formally define the concept of double permutation-equivariant representations that are equivariant to permutations of both node identities and edge relation types. We then show how double-equivariant architectures are able to self-supervise pre-train on distinct KG domains and zero-shot predict links on a new KG domain (with completely new entities and new relation types). We also introduce the concept of distributionally double equivariant positional embeddings designed to perform the same task. Finally, we empirically demonstrate the capability of the proposed models against baselines on a set of novel real-world benchmarks. More interestingly, we show that self-supervised pre-training on more KG domains increases the zero-shot ability of our model to predict on new relation types over new entities on unseen KG domains.
Submission history
From: Yangze Zhou [view email][v1] Thu, 2 Feb 2023 18:39:30 GMT (4561kb,D)
[v2] Fri, 7 Apr 2023 20:09:20 GMT (2164kb,D)
[v3] Fri, 5 May 2023 18:23:05 GMT (2167kb,D)
[v4] Sat, 13 May 2023 02:13:16 GMT (2167kb,D)
[v5] Sun, 28 May 2023 22:50:23 GMT (2565kb,D)
[v6] Tue, 3 Oct 2023 19:31:48 GMT (8704kb,D)
[v7] Thu, 14 Dec 2023 06:01:12 GMT (32135kb,D)
Link back to: arXiv, form interface, contact.