We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Artificial Intelligence

Title: The Chess Transformer: Mastering Play using Generative Language Models

Abstract: This work demonstrates that natural language transformers can support more generic strategic modeling, particularly for text-archived games. In addition to learning natural language skills, the abstract transformer architecture can generate meaningful moves on a chessboard. With further fine-tuning, the transformer learns complex gameplay by training on 2.8 million chess games in Portable Game Notation. After 30,000 training steps, OpenAI's Generative Pre-trained Transformer (GPT-2) optimizes weights for 774 million parameters. This fine-tuned Chess Transformer generates plausible strategies and displays game formations identifiable as classic openings, such as English or the Slav Exchange. Finally, in live play, the novel model demonstrates a human-to-transformer interface that correctly filters illegal moves and provides a novel method to challenge the transformer's chess strategies. We anticipate future work will build on this transformer's promise, particularly in other strategy games where features can capture the underlying complex rule syntax from simple but expressive player annotations.
Comments: 7 Pages, 6 Figures, AAAI Format, AAAI 21
Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG)
Cite as: arXiv:2008.04057 [cs.AI]
  (or arXiv:2008.04057v5 [cs.AI] for this version)

Submission history

From: Matthew Ciolino [view email]
[v1] Sun, 2 Aug 2020 18:04:36 GMT (713kb)
[v2] Tue, 11 Aug 2020 13:38:42 GMT (715kb)
[v3] Wed, 12 Aug 2020 20:05:54 GMT (438kb)
[v4] Fri, 21 Aug 2020 17:31:29 GMT (1480kb)
[v5] Fri, 18 Sep 2020 17:12:52 GMT (1575kb)

Link back to: arXiv, form interface, contact.