Computational Intelligence in Games
Description
This course addresses the basic and advanced topics in the area of computational intelligence and games. This course has three parts:
Part one addresses the basics in Evolutionary Game Theory (EGT). In this part you will learn about simple games such as scissors/rock/paper and the main focus on the strategies for playing games.
Part two is about learning agents and we focus on reinforcement learning mechanisms. There are three questions for games:
The application is on board games.
Part three contains the advanced topics in games and artificial intelligence such as how can we program an agent who can pass a Turing test? how can we consider physical constraints of a spaceship while moving in an unknown terrain? etc.
This course will be held in English and is for Bachelor students.
Lectures
- Lecturer: Sanaz Mostaghim
- Asema Hassan (Tutorials)
The lectures take place: Wednesdays 9:15-10:45 in G29 037 (in Ground Floor) Location has changed to G10-460
+++++++ The exam is on 21.07.2016 from 14:00-16:00 in HS5 +++++++
Here you will find the exam questions of last year --> Exam-WS-2015/16
Slides
- Chapter 0: Organization
- Chapter 1: Introduction
- Chapter 2: Evolutionary Game Theory
- Chapter 3: Introduction to Reinforcement Learning
- Chapter 4: Dynamic Programming and Monte Carlo Method in RL
- Scriptbook about RL (password access and only for the students of Otto von Guericke University Magdeburg) - Sorry it had to be removed
- Chapter 5: Temporal Difference Learning
- Chapter 6: Monte Carlo Tree Search
- Chapter 7: Rolling Horizon Evolutionary Algorithms
- Chapter 8: Multi-Objective Decision Making and Learning in Games
- Chapter 9: Procedural Content Generation (PCG)
- Chapter 10: CIG Research
Videos and simulations related to lectures
- Chapter 2: Hawk-Dove
- Chapter 2: Hawk-Dove-Worm
- Chapter 3: Link to MasterMind
Recorded Lectures
- Wednesday 06.04.2016: Chapter 0 and 1
- Wednesday 13.04.2016: Chapter 2 (Slides CIG-2-1 to CIG-2-25)
- Wednesday 20.04.2016: Chapter 2 (Slides CIG-2-25 to CIG-2-42)
- Wednesday 27.04.2016: Chapter 2 (finished) and Chapter 3 (Slides CIG-3-1 to CIG-3-15)
- Wednesday 04.05.2016: Chapter 3 (finished) and Chapter 4 (Slides CIG-4-1 to CIG-4-11)
- Wednesday 11.05.2016: Chapter 4 (finished)
- Wednesday 18.05.2016: Chapter 5
- Wednesday 25.05.2016: Chapter 6
- Wednesday 01.06.2016: Chapter 7
- Wednesday 08.06.2016: Chapter 8 (Slides CIG-8-1 to CIG-8-27)
- Wednesday 15.06.2016: Chapter 8 (finished)
- Wednesday 22.06.2016: Recording didn't work :-(
Tutorials
We offer tutorials on Tuesdays and Thursdays. The students have to register for one tutorial:
+++ Note: The students have to at least attend 75% of the tutorials to get the permission for the exam +++
The first tutorial will be
- 26.04.2016 at 15:15 Room 037
- 28.04.2016 at 13:15 Room K059
Overview of tutorials and assignments:
- Assignment 1 --> Solutions
- Tutorial 1 - 26.04 and 28.04.2016 : Programming 1 --> Tutorial Slides
- Tutorial 2 - 10.05 and 12.05.2016: Assignment 2 --> Tutorial Slides
- Tutorial 3 - 17.05 and 19.05.2016: Kick-Off Competition
- Tutorial 4 - 24.04 and 26.05.2016: Programming
- Tutorial 5 - 07.06 and 09.06.2016: First Presentations (Master Students)
- Tutorial 6 - 14.06 and 16.06.2016: Assignment 3 --> Tutorial Slides
- Tutorial 7 - 21.06 and 23.06.2016: Assignment 4 and Assignment 5 --> Tutorial Slides Assignment 4 and Assignment 5
- Tutorial 8 - 28.06 and 30.06.2016: Final Presentations (Master Students)
- Wednesday 06.07. - OvGU Fighting Game Competition, 18:00 - 21:00 Room G29-307
Groups Information: Link
Q/A Tutorial: Link
Submission of the assignments:
Submission of Programming Assignment should be done using www.wetransfer.com.
Upload your unity project on this site, with your group name in message detail. Send the link to asema.hassan - at - st.ovgu.de
Click here for the Chicken Game Results
Master Students:
Please note that you must deliver an extra work as we discussed during the tutorials. There will be two presentation days, on which you must present your work on the Fighting Game http://www.ice.ci.ritsumei.ac.jp/~ftgaic/index.htm:
- Presentation of maximal 5 slides
- Final Presentations
Literature
- Ian Millington and John Funge, Artificial Intelligence for Games, CRC Press, 2009
- Richard S. Sutton and Andrew G. Barto, Reinforcement Learning: An Introduction, MIT Press, Cambridge, MA, 1998
- T. L. Vincent and J. L. Brown, Evolutionary Game Theory, Natural Selection and Darwinian Dynamics, Cambridge University Press, 2012
- Jorgen W. Weibull, Evolutionary Game Theory, MIT Press, 1997
- Thomas Vincent, Evolutionary Game Theory, Natural Selection, and Darwinian Dynamics, Cambridge University Press, 2005
- Josef Hofbauer, Karl Sigmund, Evolutionary Games and Population Dynamics, Cambridge University Press, 1998
- Kalyanmoy Deb, Multi-Objective Optimization using Evolutionary Algorithms, Wiley, 2001
- Literature about PCG: Paper1, Paper2, Paper3, Paper4
- Kruse, Borgelt, Klawonn, Moewes, Ruß, Steinbrecher, Computational Intelligence, Vieweg+Teubner, Wiesbaden, 2011
- Ines Gerdes, Frank Klawonn, Rudolf Kruse, Evolutionäre Algorithmen, Vieweg, Wiesbaden, 2004
- Zbigniew Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs. Springer, Berlin, 1998