We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IR

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Information Retrieval

Title: XSimGCL: Towards Extremely Simple Graph Contrastive Learning for Recommendation

Abstract: Contrastive learning (CL) has recently been demonstrated critical in improving recommendation performance. The underlying principle of CL-based recommendation models is to ensure the consistency between representations derived from different graph augmentations of the user-item bipartite graph. This self-supervised approach allows for the extraction of general features from raw data, thereby mitigating the issue of data sparsity. Despite the effectiveness of this paradigm, the factors contributing to its performance gains have yet to be fully understood. This paper provides novel insights into the impact of CL on recommendation. Our findings indicate that CL enables the model to learn more evenly distributed user and item representations, which alleviates the prevalent popularity bias and promoting long-tail items. Our analysis also suggests that the graph augmentations, previously considered essential, are relatively unreliable and of limited significance in CL-based recommendation. Based on these findings, we put forward an eXtremely Simple Graph Contrastive Learning method (XSimGCL) for recommendation, which discards the ineffective graph augmentations and instead employs a simple yet effective noise-based embedding augmentation to generate views for CL. A comprehensive experimental study on four large and highly sparse benchmark datasets demonstrates that, though the proposed method is extremely simple, it can smoothly adjust the uniformity of learned representations and outperforms its graph augmentation-based counterparts by a large margin in both recommendation accuracy and training efficiency. The code and used datasets are released at this https URL
Comments: Extension of our SIGIR'22 paper "Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendation", Accepted by TKDE
Subjects: Information Retrieval (cs.IR)
Cite as: arXiv:2209.02544 [cs.IR]
  (or arXiv:2209.02544v4 [cs.IR] for this version)

Submission history

From: Junliang Yu [view email]
[v1] Tue, 6 Sep 2022 14:50:51 GMT (2460kb,D)
[v2] Thu, 8 Sep 2022 23:06:47 GMT (2460kb,D)
[v3] Tue, 11 Apr 2023 11:33:11 GMT (2697kb,D)
[v4] Mon, 19 Jun 2023 01:33:54 GMT (2730kb,D)

Link back to: arXiv, form interface, contact.