Neural and Evolutionary Computing

New submissions

• New submissions
• Cross-lists
• Replacements

New submissions for Thu, 30 Mar 23

[1]  arXiv:2303.16207 [pdf, other]

Title: The Quality-Diversity Transformer: Generating Behavior-Conditioned Trajectories with Decision Transformers

Authors: Valentin Macé, Raphaël Boige, Felix Chalumeau, Thomas Pierrot, Guillaume Richard, Nicolas Perrin-Gilbert

Comments: 10+7 pages

Subjects: Neural and Evolutionary Computing (cs.NE); Artificial Intelligence (cs.AI)

In the context of neuroevolution, Quality-Diversity algorithms have proven effective in generating repertoires of diverse and efficient policies by relying on the definition of a behavior space. A natural goal induced by the creation of such a repertoire is trying to achieve behaviors on demand, which can be done by running the corresponding policy from the repertoire. However, in uncertain environments, two problems arise. First, policies can lack robustness and repeatability, meaning that multiple episodes under slightly different conditions often result in very different behaviors. Second, due to the discrete nature of the repertoire, solutions vary discontinuously. Here we present a new approach to achieve behavior-conditioned trajectory generation based on two mechanisms: First, MAP-Elites Low-Spread (ME-LS), which constrains the selection of solutions to those that are the most consistent in the behavior space. Second, the Quality-Diversity Transformer (QDT), a Transformer-based model conditioned on continuous behavior descriptors, which trains on a dataset generated by policies from a ME-LS repertoire and learns to autoregressively generate sequences of actions that achieve target behaviors. Results show that ME-LS produces consistent and robust policies, and that its combination with the QDT yields a single policy capable of achieving diverse behaviors on demand with high accuracy.

Cross-lists for Thu, 30 Mar 23

[2]  arXiv:2303.16258 (cross-list from cs.AI) [pdf, other]

Title: Optimisation via encodings: a renormalisation group perspective

Authors: Konstantin Klemm, Anita Mehta, Peter F. Stadler

Comments: 17 pages, 2 figures. arXiv admin note: text overlap with arXiv:1806.05248

Subjects: Artificial Intelligence (cs.AI); Disordered Systems and Neural Networks (cond-mat.dis-nn); Neural and Evolutionary Computing (cs.NE)

The traditional way of tackling discrete optimization problems is by using local search on suitably defined cost or fitness landscapes. Such approaches are however limited by the slowing down that occurs when local minima, that are a feature of the typically rugged landscapes encountered, arrest the progress of the search process. Another way of tackling optimization problems is by the use of heuristic approximations to estimate a global cost minimum. Here we present a combination of these two approaches by using cover-encoding maps which map processes from a larger search space to subsets of the original search space. The key idea is to construct cover-encoding maps with the help of suitable heuristics that single out near-optimal solutions and result in landscapes on the larger search space that no longer exhibit trapping local minima. The processes that are typically employed involve some form of coarse-graining, and we suggest here that they can be viewed as avatars of renormalisation group transformations.

[3]  arXiv:2303.16760 (cross-list from cs.CL) [pdf, other]

Title: ACO-tagger: A Novel Method for Part-of-Speech Tagging using Ant Colony Optimization

Authors: Amirhossein Mohammadi, Sara Hajiaghajani, Mohammad Bahrani

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

Swarm Intelligence algorithms have gained significant attention in recent years as a means of solving complex and non-deterministic problems. These algorithms are inspired by the collective behavior of natural creatures, and they simulate this behavior to develop intelligent agents for computational tasks. One such algorithm is Ant Colony Optimization (ACO), which is inspired by the foraging behavior of ants and their pheromone laying mechanism. ACO is used for solving difficult problems that are discrete and combinatorial in nature. Part-of-Speech (POS) tagging is a fundamental task in natural language processing that aims to assign a part-of-speech role to each word in a sentence. In this research paper, proposed a high-performance POS-tagging method based on ACO called ACO-tagger. This method achieved a high accuracy rate of 96.867%, outperforming several state-of-the-art methods. The proposed method is fast and efficient, making it a viable option for practical applications.

Replacements for Thu, 30 Mar 23

[4]  arXiv:2212.05652 (replaced) [pdf, ps, other]

Title: PyPop7: A Pure-Python Library for Population-Based Black-Box Optimization

Authors: Qiqi Duan, Guochen Zhou, Chang Shao, Zhuowei Wang, Mingyang Feng, Yijun Yang, Qi Zhao, Yuhui Shi

Comments: 7 pages

Subjects: Neural and Evolutionary Computing (cs.NE)

[5]  arXiv:2212.04692 (replaced) [pdf, other]

Title: Attention in a family of Boltzmann machines emerging from modern Hopfield networks

Authors: Toshihiro Ota, Ryo Karakida

Comments: 15 pages, 3 figures. v2: added figures and various corrections/improvements especially in Introduction and Section 3. Published version

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[6]  arXiv:2303.16203 (replaced) [pdf, other]

Title: Your Diffusion Model is Secretly a Zero-Shot Classifier

Authors: Alexander C. Li, Mihir Prabhudesai, Shivam Duggal, Ellis Brown, Deepak Pathak

Comments: Website at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Neural and Evolutionary Computing (cs.NE); Robotics (cs.RO)

• New submissions
• Cross-lists
• Replacements