References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Peer Learning for Unbiased Scene Graph Generation
(Submitted on 31 Dec 2022 (v1), last revised 4 Mar 2023 (this version, v2))
Abstract: Unbiased scene graph generation (USGG) is a challenging task that requires predicting diverse and heavily imbalanced predicates between objects in an image. To address this, we propose a novel framework peer learning that uses predicate sampling and consensus voting (PSCV) to encourage multiple peers to learn from each other. Predicate sampling divides the predicate classes into sub-distributions based on frequency, and assigns different peers to handle each sub-distribution or combinations of them. Consensus voting ensembles the peers' complementary predicate knowledge by emphasizing majority opinion and diminishing minority opinion. Experiments on Visual Genome show that PSCV outperforms previous methods and achieves a new state-of-the-art on SGCls task with 31.6 mean.
Submission history
From: Liguang Zhou [view email][v1] Sat, 31 Dec 2022 07:56:35 GMT (2679kb,D)
[v2] Sat, 4 Mar 2023 08:13:35 GMT (2683kb,D)
Link back to: arXiv, form interface, contact.