Abstract
Why sequential decision systems need explicit downside objectives and skeptical backtesting.
Problem framing
The useful question is not which technique sounds most advanced, but which assumptions fit the data-generating process and the cost of failure. Specify the unit of generalization, prevent leakage, and decide what evidence would change the conclusion.
Method lens
A risk objective says which part of an outcome distribution matters. Its usefulness depends on estimation quality, protocol design, and whether the reported risk measure matches the real decision.
Evaluation before conclusion
- Split at the level of the intended generalization claim.
- Report variation across repetitions or folds when available.
- Compare relevant baselines under the same protocol.
- Separate retrospective discrimination from operational utility.
- Record preprocessing, configuration, and expected outputs.
Limitations
This is a research-communication note, not clinical, diagnostic, or investment guidance. It condenses method choices and does not replace the underlying paper, dataset documentation, or domain-expert review.
Related paper
References
Content and links last reviewed 2026-07-26.