| Title: | Local and global stimuli in reinforcement learning |
|---|
| Authors: | ID Jia, Danyang (Author)
ID Guo, Hao (Author)
ID Song, Zhao (Author)
ID Shi, Lei (Author)
ID Deng, Xinyang (Author)
ID Perc, Matjaž (Author)
ID Wang, Zhen (Author) |
|---|
| Files: |  RAZ_Jia_Danyang_2021.pdf (5,68 MB)
MD5: 82E810B122D2160F483816E364A4F9B5
 https://iopscience.iop.org/article/10.1088/1367-2630/ac170a
|
|---|
| Language: | English |
|---|
| Work type: | Scientific work |
|---|
| Typology: | 1.01 - Original Scientific Article |
|---|
| Organization: | FNM - Faculty of Natural Sciences and Mathematics
|
|---|
| Abstract: | In efforts to resolve social dilemmas, reinforcement learning is an alternative to imitation and exploration in evolutionary game theory. While imitation and exploration rely on the performance of neighbors, in reinforcement learning individuals alter their strategies based on their own performance in the past. For example, according to the Bush-Mosteller model of reinforcement learning, an individual's strategy choice is driven by whether the received payoff satisfies a preset aspiration or not. Stimuli also play a key role in reinforcement learning in that they can determine whether a strategy should be kept or not. Here we use the Monte Carlo method to study pattern formation and phase transitions towards cooperation in social dilemmas that are driven by reinforcement learning. We distinguish local and global players according to the source of the stimulus they experience. While global players receive their stimuli from the whole neighborhood, local players focus solely on individual performance. We show that global players play a decisive role in ensuring cooperation, while local players fail in this regard, although both types of players show properties of "moody cooperators". In particular, global players evoke stronger conditional cooperation in their neighborhoods based on direct reciprocity, which is rooted in the emerging spatial patterns and stronger interfaces around cooperative clusters. |
|---|
| Keywords: | evolutionary game theory, cooperation, learning, social physics |
|---|
| Publication status: | Published |
|---|
| Publication version: | Version of Record |
|---|
| Submitted for review: | 16.06.2021 |
|---|
| Article acceptance date: | 22.07.2021 |
|---|
| Publication date: | 10.08.2021 |
|---|
| Year of publishing: | 2021 |
|---|
| Number of pages: | str. 1-11 |
|---|
| Numbering: | Letn. 23, št. 8 |
|---|
| PID: | 20.500.12556/DKUM-91120  |
|---|
| UDC: | 53 |
|---|
| ISSN on article: | 1367-2630 |
|---|
| COBISS.SI-ID: | 72946691 |
|---|
| DOI: | 10.1088/1367-2630/ac170a |
|---|
| Publication date in DKUM: | 03.03.2025 |
|---|
| Views: | 0 |
|---|
| Downloads: | 1 |
|---|
| Metadata: |    |
|---|
| Categories: | Misc.
|
|---|
|
:
|
Copy citation |
|---|
| | | | Average score: | (0 votes) |
|---|
| Your score: | Voting is allowed only for logged in users. |
|---|
| Share: |  |
|---|
Hover the mouse pointer over a document title to show the abstract or click
on the title to get all document metadata. |
