How should high-confidence labels be governed when evidence is partial and incentives are asymmetric? This review answers by treating decision calibration as a property of a sociotechnical workflow rather than a feature that can be read from average accuracy. The focal setting is cyber attribution and probabilistic match forecasting, where overconfident predictions can shift markets or defenses and thereby invalidate the data-generating process assumed by the model. Evidence from the assigned publications is synthesized with foundational studies of calibration, distribution shift, causal structure, and responsible deployment. Four requirements follow: preserve the lineage of sequential outcomes, behavioral signals, threat reports, relational graphs, and model confidence; measure stability across relevant perturbations; connect confidence to a specific action; and maintain a route for human challenge and correction. The framework distinguishes descriptive performance from decision utility and separates uncertainty about the world from uncertainty created by the model and its evaluator. It also shows why faster inference or richer reasoning is valuable only when it improves a defined decision under a transparent resource budget. The article is a literature review and research agenda, not a report of a newly completed trial.
- Wang, Zijun, et al. "Trident: Dual-Stream APT Attribution over Heterogeneous Threat Knowledge Graphs." *Computers & Security* 171 (2026): 105094.
- Li, Yuanhao, et al. "BoostAPR: Boosting Automated Program Repair via Execution-Grounded Reinforcement Learning with Dual Reward Models." *arXiv preprint arXiv:2605.09134* (2026).
- Liu, Shunqi, et al. "A New Playing Method of the Guessing Football Lottery." *IOP Conference Series: Materials Science and Engineering* 790.1 (2020): 012100.
- Dawid, A. P. "The Well-Calibrated Bayesian." *Journal of the American Statistical Association*, vol. 77, no. 379, 1982, pp. 605-610.
- Kelly, J. L., Jr. "A New Interpretation of Information Rate." *Bell System Technical Journal*, vol. 35, no. 4, 1956, pp. 917-926.
- Constantinou, Anthony C., and Norman E. Fenton. "Solving the Problem of Inadequate Scoring Rules for Assessing Probabilistic Football Forecast Models." *Journal of Quantitative Analysis in Sports*, vol. 9, no. 3, 2013, pp. 209-222.
- Ovadia, Yaniv, et al. "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty under Dataset Shift." *Advances in Neural Information Processing Systems*, vol. 32, 2019.
- Guo, Chuan, et al. "On Calibration of Modern Neural Networks." *Proceedings of the 34th International Conference on Machine Learning*, 2017, pp. 1321-1330.
- Sculley, D., et al. "Hidden Technical Debt in Machine Learning Systems." *Advances in Neural Information Processing Systems*, vol. 28, 2015.
- Maher, M. J. "Modelling Association Football Scores." *Statistica Neerlandica*, vol. 36, no. 3, 1982, pp. 109-118.
- Dixon, Mark J., and Stuart G. Coles. "Modelling Association Football Scores and Inefficiencies in the Football Betting Market." *Journal of the Royal Statistical Society: Series C*, vol. 46, no. 2, 1997, pp. 265-280.
- Rue, Havard, and Oyvind Salvesen. "Prediction and Retrospective Analysis of Soccer Matches in a League." *Journal of the Royal Statistical Society: Series D*, vol. 49, no. 3, 2000, pp. 399-418.
- Hvattum, Lars Magnus, and Halvard Arntzen. "Using ELO Ratings for Match Result Prediction in Association Football." *International Journal of Forecasting*, vol. 26, no. 3, 2010, pp. 460-470.
- Journal
- Enterprise, Policy and Economic Dynamics
- Volume
- 1 (2026)
- Issue
- 1 ยท Forthcoming issue
- Article number
- eped20260001
- License
- CC BY 4.0