Conceptos Básicos
This model explores how a hierarchical network of decision-making agents can coordinate their actions to match an uncertain world state, with agents sharing judgements but not direct observations or actions.
Resumen
The key aspects of this hierarchical multi-agent decision-making model are:
- The decision process is split into three distinct steps: observation, judgement, and action.
- Agents share their judgements about the best course of action, but not their observations or actions.
- The model has an explicitly hierarchical binary-tree structure, with higher-level agents acting more slowly but with less noise in their observations.
- The model is analyzed under various conditions, including a clear/static world, a noisy/static world, a clear/malleable world, and a noisy/malleable world.
The results show that the network can converge to a state that matches the world well, but the agents' perceived success may be lower than the actual success due to the hierarchical structure and noise. The model also exhibits a tendency for the world state to escalate over time due to the agents' actions, which requires further investigation.
The paper discusses potential extensions, such as exploring changing world dynamics, competition between decision networks, and strategic vs. tactical decision-making at different levels of the hierarchy.
Estadísticas
The world state W starts at a non-zero finite value (e.g., W = 3).
The measurement noise proportionality is set to ψ = √2, and the noise prefactor is η = 10^-3.
The "hammer" parameter (impact of agent actions on the world) is set to a small value (e.g., 2 × 10^-3), scaled by 1/N.
The default judgement parameters are σ = (1-3θ, 0, 0, θ, θ, θ), with θ = 1/10.
The default action parameters are α = (0, φ, 0, 1-φ, 0, 0), with φ = 2/10.
Citas
"Decision making can be difficult when there are many actors (or agents) who may be coordinating or competing to achieve their various ideas of the optimum outcome."
"Key features of agent behaviour are (a) the separation of its decision making process into three distinct steps: observation, judgement, and action; and (b) the evolution of coordination by the sharing of judgements."