Modeling

Before solving these exercises you should have read Overview and Examples.

Tic-Tac-Toe

Task: How many actions has Tic-tac-toe seen from an agent’s perspective?

Solution:

# your answer

Task: How many states has Tic-tac-toe seen from an agent’s perspective, that is, if the next move is the agent’s move? Include end states, too (although the agent can’t choose any valid action based on an end state). Give a rough estimate (upper bound), then try to find better estimates. Bonus: write some Python code to get the exact value.

Solution:

# your answer

Connect Four

Task: How many actions has Connect four seen from an agent’s perspective?

Solution:

# your answer

Task: Give a simple and maybe also a more precise upper bounds for the number of states in Connect four.

Solution:

# your answer