We gratefully acknowledge support from
the Simons Foundation and member institutions.

Multiagent Systems

New submissions

[ total of 15 entries: 1-15 ]
[ showing up to 2000 entries per page: fewer | more ]

New submissions for Tue, 5 Jul 22

[1]  arXiv:2207.00710 [pdf, ps, other]
Title: Separating and Collapsing Electoral Control Types
Comments: The arXiv.org metadata abstract is an abridged version; please see the paper for the full abstract
Subjects: Multiagent Systems (cs.MA); Computer Science and Game Theory (cs.GT)

[HHM20] discovered, for 7 pairs (C,D) of seemingly distinct standard electoral control types, that C and D are identical: For each input I and each election system, I is a "yes" instance of both C and D, or of neither. Surprisingly this had gone undetected, even as the field was score-carding how many standard control types election systems were resistant to; various "different" cells on such score cards were, unknowingly, duplicate effort on the same issue. This naturally raises the worry that other pairs of control types are also identical, and so work still is being needlessly duplicated.
We determine, for all standard control types, which pairs are, for elections whose votes are linear orderings of the candidates, always identical. We show that no identical control pairs exist beyond the known 7. We for 3 central election systems determine which control pairs are identical ("collapse") with respect to those particular systems, and we explore containment/incomparability relationships between control pairs. For approval voting, which has a different "type" for its votes, [HHM20]'s 7 collapses still hold. But we find 14 additional collapses that hold for approval voting but not for some election systems whose votes are linear orderings. We find 1 additional collapse for veto. We prove that each of the 3 election systems mentioned have no collapses other than those inherited from [HHM20] or added here. But we show many new containment relationships that hold between some separating control pairs, and for each separating pair of standard types classify its separation in terms of containment (always, and strict on some inputs) or incomparability.
Our work, for the general case and these 3 important election systems, clarifies the landscape of the 44 standard control types, for each pair collapsing or separating them, and also providing finer-grained information on the separations.

[2]  arXiv:2207.00725 [pdf, other]
Title: Metacognitive Decision Making Framework for Multi-UAV Target Search Without Communication
Comments: 12 pages, 9 figures, 8 tables
Subjects: Multiagent Systems (cs.MA)

This paper presents a new Metacognitive Decision Making (MDM) framework inspired by human-like metacognitive principles. The MDM framework is incorporated in unmanned aerial vehicles (UAVs) deployed for decentralized stochastic search without communication for detecting stationary targets (fixed/sudden pop-up) and dynamic targets. The UAVs are equipped with multiple sensors (varying sensing capability) and search for targets in a largely unknown area. The MDM framework consists of a metacognitive component and a self-cognitive component. The metacognitive component helps to self-regulate the search with multiple sensors addressing the issues of "which-sensor-to-use", "when-to-switch-sensor", and "how-to-search". Each sensor possesses inverse characteristics for the sensing attributes like sensing range and accuracy. Based on the information gathered by multiple sensors carried by each UAV, the self-cognitive component regulates different levels of stochastic search and switching levels for effective searching. The lower levels of search aim to localize the search space for the possible presence of a target (detection) with different sensors. The highest level of a search exploits the search space for target confirmation using the sensor with the highest accuracy among all sensors. The performance of the MDM framework with two sensors having low accuracy with wide range sensor for detection and increased accuracy with low range sensor for confirmation is evaluated through Monte-Carlo simulations and compared with six multi-UAV stochastic search algorithms (three self-cognitive searches and three self and social-cognitive based search). The results indicate that the MDM framework is efficient in detecting and confirming targets in an unknown environment.

[3]  arXiv:2207.00763 [pdf, other]
Title: Hierarchical Dynamic Routing in Complex Networks via Topologically-decoupled and Cooperative Reinforcement Learning Agents
Subjects: Multiagent Systems (cs.MA)

The transport capacity of a communication network can be characterized by the transition from a free-flow state to a congested state. Here, we propose a dynamic routing strategy in complex networks based on hierarchical bypass selections. The routing decisions are made by the reinforcement learning agents implemented at selected nodes with high betweenness centrality. The learning processes of the agents are decoupled from each other due to the degeneracy of their bypasses. Through interactions mediated by the underlying traffic dynamics, the agents act cooperatively, and coherent actions arise spontaneously. With only a small number of agents, the transport capacities are significantly improved, including in real-world Internet networks at the router level and the autonomous system level. Our strategy is also resilient to link removals.

[4]  arXiv:2207.00964 [pdf, other]
Title: NVIF: Neighboring Variational Information Flow for Large-Scale Cooperative Multi-Agent Scenarios
Subjects: Multiagent Systems (cs.MA)

Communication-based multi-agent reinforcement learning (MARL) provides information exchange between agents, which promotes the cooperation. However, existing methods cannot perform well in the large-scale multi-agent system. In this paper, we adopt neighboring communication and propose a Neighboring Variational Information Flow (NVIF) to provide efficient communication for agents. It employs variational auto-encoder to compress the shared information into a latent state. This communication protocol does not rely dependently on a specific task, so that it can be pre-trained to stabilize the MARL training. Besides. we combine NVIF with Proximal Policy Optimization (NVIF-PPO) and Deep Q Network (NVIF-DQN), and present a theoretical analysis to illustrate NVIF-PPO can promote cooperation. We evaluate the NVIF-PPO and NVIF-DQN on MAgent, a widely used large-scale multi-agent environment, by two tasks with different map sizes. Experiments show that our method outperforms other compared methods, and can learn effective and scalable cooperation strategies in the large-scale multi-agent system.

[5]  arXiv:2207.01010 [pdf, other]
Title: Government Intervention in Catastrophe Insurance Markets: A Reinforcement Learning Approach
Subjects: Multiagent Systems (cs.MA); Machine Learning (cs.LG); General Economics (econ.GN)

This paper designs a sequential repeated game of a micro-founded society with three types of agents: individuals, insurers, and a government. Nascent to economics literature, we use Reinforcement Learning (RL), closely related to multi-armed bandit problems, to learn the welfare impact of a set of proposed policy interventions per $1 spent on them. The paper rigorously discusses the desirability of the proposed interventions by comparing them against each other on a case-by-case basis. The paper provides a framework for algorithmic policy evaluation using calibrated theoretical models which can assist in feasibility studies.

[6]  arXiv:2207.01017 [pdf, other]
Title: "Y'all are just too sensitive": A computational ethics approach to understanding how prejudice against marginalized communities becomes epistemic belief
Authors: Johannah Sprinz
Comments: 18 pages, 15 figures. This research was originally conducted as part of the Master's practical seminar "Computational Ethics" at LMU Munich in the winter term of 2021, supervised by Prof. Dr. Francois Bry. Significant contributions by Matthias Fruth are acknowledged. The model available on the web under https://netlogoweb.org/web?this https URL
Subjects: Multiagent Systems (cs.MA); Computers and Society (cs.CY)

Members of marginalized communities are often accused of being "too sensitive" when subjected to supposedly harmless acts of microaggression. This paper explores a simulated society consisting of marginalized and non-marginalized agents who interact and may, based on their individually held convictions, commit acts of microaggressions. Agents witnessing a microaggression might condone, ignore or condemn such microaggressions, thus potentially influencing a perpetrator's conviction. A prototype model has been implemented in NetLogo, and possible applications are briefly discussed.

Cross-lists for Tue, 5 Jul 22

[7]  arXiv:2207.00823 (cross-list from cs.DC) [pdf, ps, other]
Title: Communication Pattern Logic: Epistemic and Topological Views
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Multiagent Systems (cs.MA)

We propose communication pattern logic. A communication pattern describes how processes or agents inform each other, independently of the information content. The full information protocol in distributed computing is the special case wherein all agents inform each other. We study this protocol in distributed computing models where communication might fail: an agent is certain about the messages it receives, but it is uncertain about the messages other agents have received. In a dynamic epistemic logic with distributed knowledge and with modalities for communication patterns, the latter are interpreted by updating Kripke models. We propose an axiomatization of communication pattern logic, and we show that collective bisimilarity (comparing models on their distributed knowledge) is preserved when updating models with communication patterns. We can also interpret communication patterns by updating simplicial complexes, a well-known topological framework for distributed computing. We show that the different semantics correspond, and propose collective bisimulation between simplicial complexes.

[8]  arXiv:2207.01346 (cross-list from eess.SY) [pdf, other]
Title: Can Competition Outperform Collaboration? The Role of Malicious Agents
Comments: To be submitted to IEEE TAC
Subjects: Systems and Control (eess.SY); Multiagent Systems (cs.MA); Robotics (cs.RO)

We investigate a novel approach to resilient distributed optimization with quadratic costs in a Networked Control System prone to exogenous attacks that make agents misbehave. In contrast with commonly adopted filtering strategies, we draw inspiration from a game-theoretic formulation of the consensus problem and argue that adding competition to the mix can improve resilience in the presence of malicious agents. Our intuition is corroborated by analytical and numerical results showing that (i) our strategy reveals a nontrivial performance trade-off between full collaboration and full competition, and (ii) such competitionbased approach can outperform state-of-the-art algorithms based on Mean Subsequence Reduced. Finally, we study impact of communication topology and connectivity on performance, pointing out insights to robust network design.

[9]  arXiv:2207.01456 (cross-list from cs.CY) [pdf, other]
Title: How Routing Strategies Impact Urban Emissions
Subjects: Computers and Society (cs.CY); Multiagent Systems (cs.MA)

Navigation apps use routing algorithms to suggest the best path to reach a user's desired destination. Although undoubtedly useful, navigation apps' impact on the urban environment (e.g., carbon dioxide emissions and population exposure to pollution) is still largely unclear. In this work, we design a simulation framework to assess the impact of routing algorithms on carbon dioxide emissions within an urban environment. Using APIs from TomTom and OpenStreetMap, we find that settings in which either all vehicles or none of them follow a navigation app's suggestion lead to the worst impact in terms of CO2 emissions. In contrast, when just a portion (around half) of vehicles follow these suggestions, and some degree of randomness is added to the remaining vehicles' paths, we observe a reduction in the overall CO2 emissions over the road network. Our work is a first step towards designing next-generation routing principles that may increase urban well-being while satisfying individual needs.

[10]  arXiv:2207.01589 (cross-list from cs.GT) [pdf, ps, other]
Title: Repeatedly Matching Items to Agents Fairly and Efficiently
Comments: 20 pages
Subjects: Computer Science and Game Theory (cs.GT); Multiagent Systems (cs.MA)

We consider a novel setting where a set of items are matched to the same set of agents repeatedly over multiple rounds. Each agent gets exactly one item per round, which brings interesting challenges to finding efficient and/or fair {\em repeated matchings}. A particular feature of our model is that the value of an agent for an item in some round depends on the number of rounds in which the item has been used by the agent in the past. We present a set of positive and negative results about the efficiency and fairness of repeated matchings. For example, when items are goods, a variation of the well-studied fairness notion of envy-freeness up to one good (EF1) can be satisfied under certain conditions. Furthermore, it is intractable to achieve fairness and (approximate) efficiency simultaneously, even though they are achievable separately. For mixed items, which can be goods for some agents and chores for others, we propose and study a new notion of fairness that we call {\em swap envy-freeness} (swapEF).

Replacements for Tue, 5 Jul 22

[11]  arXiv:2112.00900 (replaced) [pdf, other]
Title: Empirical Game-Theoretic Analysis for Mean Field Games
Comments: 14 papes, 3 figures
Subjects: Multiagent Systems (cs.MA)
[12]  arXiv:2112.04454 (replaced) [pdf, other]
Title: Greedy-based Value Representation for Optimal Coordination in Multi-agent Reinforcement Learning
Subjects: Multiagent Systems (cs.MA)
[13]  arXiv:2004.11856 (replaced) [pdf, other]
Title: Decentralized linear quadratic systems with major and minor agents and non-Gaussian noise
Comments: 16 pages, submitted to the IEEE Transactions on Automatic Control
Subjects: Systems and Control (eess.SY); Multiagent Systems (cs.MA); Robotics (cs.RO)
[14]  arXiv:2109.00359 (replaced) [pdf, other]
Title: Can Decentralized Control Outperform Centralized? The Role of Communication Latency
Comments: 11 pages, 13 figures; submitted to IEEE Transactions on Control of Network Systems; revised version after first submission
Subjects: Optimization and Control (math.OC); Multiagent Systems (cs.MA)
[15]  arXiv:2206.10158 (replaced) [pdf, other]
Title: Certifiably Robust Policy Learning against Adversarial Communication in Multi-agent Systems
Subjects: Machine Learning (cs.LG); Multiagent Systems (cs.MA)
[ total of 15 entries: 1-15 ]
[ showing up to 2000 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, cs, recent, 2207, contact, help  (Access key information)