Partially observable Markov decision processes (POMDPs) provide a principled framework
for sequential planning in uncertain single agent settings. An extension of POMDPs to
multiagent settings, called interactive POMDPs (I-POMDPs), replaces POMDP belief spaces
with interactive hierarchical belief systems which represent an agents belief about the
physical world, about beliefs of other agents, and about their beliefs about others beliefs.
This modification makes the difficulties of obtaining solutions due to complexity of the belief …

Partially observable Markov decision processes (POMDPs) provide a principled framework
for sequential planning in uncertain single agent settings. An extension of POMDPs to
multiagent settings, called interactive POMDPs (I-POMDPs), replaces POMDP belief spaces
with interactive hierarchical belief systems which represent an agent's belief about the
physical world, about beliefs of other agents, and about their beliefs about others' beliefs.
This modification makes the difficulties of obtaining solutions due to complexity of the belief …