Dutch Books and Money Pumps: Rectifying Vulnerabilities in LLMs Through Rationality

LLMs commonly fail to be probabilistically coherent and to have transitive preferences, making them vulnerable to Dutch books and money pumps as they are increasingly used as agents in real-world tasks. We frame this as an aggregation problem and introduce a dedicated rationality layer that uses methods from social epistemology and social choice theory, including a novel hierarchical voting rule, to make LLM outputs coherent and transitive in an explainable way.

Recommended citation: Chadwick, A., Kahng, A., Kipper, J. (2025). "Dutch Books and Money Pumps: Rectifying Vulnerabilities in LLMs Through Rationality." HAR 2025.
Download Paper