Errors That Should Compound, and When They Do: The Product Rule Assumes Independent Steps, Conformal Guarantees Assume Exchangeable Instances, and the Unit of Independence Decides What Each Can Claim
Abstract
Life of Research
(c) 2026 Pranay Mahendrakar. Licensed under CC BY 4.0.
Two bodies of work quantify uncertainty in multi-step language-model reasoning, and both rest on an independence assumption placed at some unit. Step-level error models multiply per-step reliabilities, which, at an illustrative 95% per-step accuracy, predicts that a fifty-step chain succeeds about 8% of the time; yet longer thinking often helps, and correct answers are frequently reached through erroneous steps. Conformal methods are imported for distribution-free guarantees, yet exchangeability, their one assumption, fails between the steps of an autoregressive chain by construction. This paper argues that the two problems share a structure: in each, what can be claimed depends on the unit at which independence is assumed. The product rule holds only if every step is load-bearing, step errors are independent, and failure is absorbing. Published measurements break each premise. Fed the true per-step error rates, with errors positively associated as the evidence finds, the product would then understate success; fed the clean-context rates that are usually measured, it can err in either direction, because errors in context raise later error rates. The breakage tracks model-relative task difficulty: in one study a single corrupted step propagated to the answer in 3.9% of continuations on an easy benchmark and 64.5% on a hard arithmetic task. Within that evidence, errors compound sharply where the task is hard for the model and rarely where it is easy. The conformal literature, where it is careful, names its unit and does not assume exchangeable steps: it lifts the unit to the whole reasoning instance, and its guarantees then hold, but only marginally over instances drawn from the calibration distribution, only about the annotation used, and not under the deployment shift that agent loops create. Composing per-step guarantees repeats the product rule's independence premise; a union bound avoids the premise at the price of conservatism, and the methods that avoid both calibrate the chain as one unit. What is offered is less a new finding than a side-by-side account: a synthesis of published measurements, a table of what each unit licenses, a procedure for reading uncertainty claims, and six measurements that would decide what is still open. No new data were collected.
Questions about this paper
Who wrote "Errors That Should Compound, and When They Do"?
Pranay Mahendrakar wrote "Errors That Should Compound, and When They Do: The Product Rule Assumes Independent Steps, Conformal Guarantees Assume Exchangeable Instances, and the Unit of Independence Decides What Each Can Claim", published 1 Oct 2026. Pranay Mahendrakar is an Indian AI specialist and LLM engineer based in Bengaluru, India. He is the Managing Director of SonyTech, Nodal Coordinator at IIRS-ISRO, and an instructor at Tutorials Point. His work covers large language models, natural language processing, computer vision and retrieval-augmented generation. He publishes open-access research papers and is the author of three books: Just AI With Pranay, Multiverse of AI and It's Me LLM.
Is "Errors That Should Compound, and When They Do" free to read?
Yes. "Errors That Should Compound, and When They Do" by Pranay Mahendrakar is open access under a Creative Commons Attribution 4.0 licence, with the full PDF available from Zenodo at https://doi.org/10.5281/zenodo.23086063. There is no paywall and no account required.
How do I cite "Errors That Should Compound, and When They Do"?
Cite the DOI: Mahendrakar, P. (2026). Errors That Should Compound, and When They Do: The Product Rule Assumes Independent Steps, Conformal Guarantees Assume Exchangeable Instances, and the Unit of Independence Decides What Each Can Claim. Zenodo. https://doi.org/10.5281/zenodo.23086063 A BibTeX entry is provided on this page.