Current browse context:
cs.CL
Change to browse by:
References & Citations
Computer Science > Computation and Language
Title: Faith and Fate: Limits of Transformers on Compositionality
(Submitted on 29 May 2023 (v1), last revised 31 Oct 2023 (this version, v3))
Abstract: Transformer large language models (LLMs) have sparked admiration for their exceptional performance on tasks that demand intricate multi-step reasoning. Yet, these models simultaneously show failures on surprisingly trivial problems. This begs the question: Are these errors incidental, or do they signal more substantial limitations? In an attempt to demystify transformer LLMs, we investigate the limits of these models across three representative compositional tasks -- multi-digit multiplication, logic grid puzzles, and a classic dynamic programming problem. These tasks require breaking problems down into sub-steps and synthesizing these steps into a precise answer. We formulate compositional tasks as computation graphs to systematically quantify the level of complexity, and break down reasoning steps into intermediate sub-procedures. Our empirical findings suggest that transformer LLMs solve compositional tasks by reducing multi-step compositional reasoning into linearized subgraph matching, without necessarily developing systematic problem-solving skills. To round off our empirical study, we provide theoretical arguments on abstract multi-step reasoning problems that highlight how autoregressive generations' performance can rapidly decay with\,increased\,task\,complexity.
Submission history
From: Nouha Dziri [view email][v1] Mon, 29 May 2023 23:24:14 GMT (4815kb,D)
[v2] Thu, 1 Jun 2023 20:50:32 GMT (5660kb,D)
[v3] Tue, 31 Oct 2023 16:35:07 GMT (5117kb,D)
Link back to: arXiv, form interface, contact.