Metraipolis › archive › dc_f6722a2e6809
Counterfactual Fragility Certificates: Exposing High-Confidence Brittleness under Structured Evidence Failure — arXiv:2609.00366
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.00366
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-17T06:33:15.004Z
- SHA-256 of the archived text
302b980e19a068b72e9f448483ab299a33bea5dae6105aae03d65fd2d4e5daa0- Stable URL of this page
https://metraipolis.com/documento/dc_f6722a2e6809
How to cite
Counterfactual Fragility Certificates: Exposing High-Confidence Brittleness under Structured Evidence Failure — arXiv:2609.00366 — arXiv (en), https://arxiv.org/abs/2609.00366 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f6722a2e6809 (Metraipolis archive dc_f6722a2e6809, sha256 302b980e19a068b72e9f448483ab299a33bea5dae6105aae03d65fd2d4e5daa0)
BibTeX
@misc{dcf6722a2e6809,
title = {Counterfactual Fragility Certificates: Exposing High-Confidence Brittleness under Structured Evidence Failure — arXiv:2609.00366},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.00366},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f6722a2e6809; sha256 302b980e19a068b72e9f448483ab299a33bea5dae6105aae03d65fd2d4e5daa0},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.00366. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
High test accuracy and good aggregate calibration do not show whether an individual prediction is structurally supported by its evidence. In tabular decision systems, failures often occur when a feature family becomes unavailable, delayed, noisy, stale, or low-trust while the model remains highly confident. Existing calibration, uncertainty, selective-prediction, explanation, and perturbation methods provide scalar scores or attribution maps, but not a recomputable audit object answering: under a declared evidence-failure protocol, what trajectory makes this prediction lose support? We introduce Counterfactual Fragility Certificates (CFC), a model-agnostic protocol-level audit certificate-not a formal robustness certificate-that maps each prediction into an ordered evidence-failure trajectory summarized by greedy flip budget, normalized margin-collapse area, degradation thresholds, and fragility dominance score. Across seven tabular benchmarks and strong linear, tree-based, boosting, and neural baselines, CFC-FDS identifies independently brittle high-confidence cases with 0.915 AUROC, improving over the strongest non-certificate score by +0.405. The advantage persists across perturbation, permutation-importance, group-SHAP, baseline-choice, seed-variance, budgeted-review, and naturalistic field-unavailability checks. Under a 20% review budget, CFC-FDS captures 88.9% of brittle high-confidence cases, compared with 31.8-37.4% for confidence and energy scores. We also evaluate fragility-aware regularization and brittleness-aware temperature correction as secondary uses. CFC provides a concrete reliability framework for exposing high-confidence brittleness missed by ordinary score-centric evaluation. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-02 in cs.AI). Categorie arXiv: Machine Learning (cs.LG) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2609.00366 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-17T06:15:12.773Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-02?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).