We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Self-Supervised Graph Representation Learning via Topology Transformations

Abstract: We present the Topology Transformation Equivariant Representation learning, a general paradigm of self-supervised learning for node representations of graph data to enable the wide applicability of Graph Convolutional Neural Networks (GCNNs). We formalize the proposed model from an information-theoretic perspective, by maximizing the mutual information between topology transformations and node representations before and after the transformations. We derive that maximizing such mutual information can be relaxed to minimizing the cross entropy between the applied topology transformation and its estimation from node representations. In particular, we seek to sample a subset of node pairs from the original graph and flip the edge connectivity between each pair to transform the graph topology. Then, we self-train a representation encoder to learn node representations by reconstructing the topology transformations from the feature representations of the original and transformed graphs. In experiments, we apply the proposed model to the downstream node classification, graph classification and link prediction tasks, and results show that the proposed method outperforms the state-of-the-art unsupervised approaches.
Comments: Accepted to IEEE Transactions on Knowledge and Data Engineering (TKDE)
Subjects: Machine Learning (cs.LG); Social and Information Networks (cs.SI); Signal Processing (eess.SP)
Cite as: arXiv:2105.11689 [cs.LG]
  (or arXiv:2105.11689v2 [cs.LG] for this version)

Submission history

From: Xiang Gao [view email]
[v1] Tue, 25 May 2021 06:11:03 GMT (501kb,D)
[v2] Thu, 2 Dec 2021 07:32:15 GMT (799kb,D)

Link back to: arXiv, form interface, contact.