Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Gradient Surgery for Multi-Task Learning
(Submitted on 19 Jan 2020 (v1), last revised 22 Dec 2020 (this version, v4))
Abstract: While deep learning and deep reinforcement learning (RL) systems have demonstrated impressive results in domains such as image classification, game playing, and robotic control, data efficiency remains a major challenge. Multi-task learning has emerged as a promising approach for sharing structure across multiple tasks to enable more efficient learning. However, the multi-task setting presents a number of optimization challenges, making it difficult to realize large efficiency gains compared to learning tasks independently. The reasons why multi-task learning is so challenging compared to single-task learning are not fully understood. In this work, we identify a set of three conditions of the multi-task optimization landscape that cause detrimental gradient interference, and develop a simple yet general approach for avoiding such interference between task gradients. We propose a form of gradient surgery that projects a task's gradient onto the normal plane of the gradient of any other task that has a conflicting gradient. On a series of challenging multi-task supervised and multi-task RL problems, this approach leads to substantial gains in efficiency and performance. Further, it is model-agnostic and can be combined with previously-proposed multi-task architectures for enhanced performance.
Submission history
From: Tianhe Yu [view email][v1] Sun, 19 Jan 2020 06:33:47 GMT (2806kb,D)
[v2] Tue, 28 Apr 2020 23:41:08 GMT (2911kb,D)
[v3] Fri, 23 Oct 2020 06:07:19 GMT (7635kb,D)
[v4] Tue, 22 Dec 2020 00:35:46 GMT (7571kb,D)
Link back to: arXiv, form interface, contact.