Xixi Logic Seminars #33

Speaker: Ho-fung Leung (Chinese University of Hong Kong)
Date & Time: 10 May 2016 (Tuesday), 09:30 – 11:00
Place: Seminar room #259, Main teaching building, Xixi campus, Zhejiang University

Reciprocal Social Strategy in Social Repeated Games

In an artificial society where  agents repeatedly interact with one another,  achieving high level of social utility is generally a challenge. This is especially true when the participating agents are self-interested, and that there is no central authority to coordinate, and direct communication or negotiation are not possible.  Recently, we had studied a new game theoretic approach, where a new type of repeated game as well as a new reinforcement learning based agent learning method were proposed.  In particular, the game mechanism differs from traditional repeated games in that the agents are anonymous, and the agents interact with randomly chosen opponents. The learning  mechanism allows agents to coordinate without negotiations. Despite the promising initial results, however, extended simulation reveals that the outcomes are not stable in the long run, as the high level of cooperation is eventually not sustainable. We revisit the problem and propose a new learning mechanism as follows. First, we propose an enhanced Q-learning-based framework that allows the agents to better capture both the individual and social utilities that they have learned through observations. Second, we propose a new concept of ‘social attitude’ for determining the action of the agents throughout the game. Simulation results reveal that this approach can achieve higher social utility, including close-to-optimal results in some scenarios, and more importantly, the results seem to be sustainable.