Metraipolis › archive › dc_6db359732d33

Beyond AI Literacy: A Structured Review and Exploratory Meta-Analysis of Measures for Competent Generative-AI Use — arXiv:2609.15624

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.15624
License (as archived)
CC0-1.0
Archived
2026-10-15T22:53:56.478Z
SHA-256 of the archived text
320a62169eb2c59cba992303c6256c903c5852c57492aa99b70bb0b458c1d312
Stable URL of this page
https://metraipolis.com/documento/dc_6db359732d33

How to cite

Beyond AI Literacy: A Structured Review and Exploratory Meta-Analysis of Measures for Competent Generative-AI Use — arXiv:2609.15624 — arXiv (en), https://arxiv.org/abs/2609.15624 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_6db359732d33 (Metraipolis archive dc_6db359732d33, sha256 320a62169eb2c59cba992303c6256c903c5852c57492aa99b70bb0b458c1d312)
BibTeX
@misc{dc6db359732d33,
  title = {Beyond AI Literacy: A Structured Review and Exploratory Meta-Analysis of Measures for Competent Generative-AI Use — arXiv:2609.15624},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.15624},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_6db359732d33; sha256 320a62169eb2c59cba992303c6256c903c5852c57492aa99b70bb0b458c1d312},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.15624. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Researchers assessing competent generative-AI use at work must choose among self-reports, objective tests, and measures of oversight and reliance. We conducted a structured, seeded review of 24 focal empirical publications, starting from the 2024 COSMIN-based review and adding a targeted update through 17 August 2026. We grouped the measures into four domains: knowledge and use, epistemic oversight, reliance calibration, and operational control of tool-using agents. In an exploratory meta-analysis, we pooled three direct subjective-objective correlations from one research program (REML r = .055; Hartung-Knapp 95% CI [-.047, .156]; combined reported N = 2,765). We could not resolve a discrepancy between the largest study's reported correlation and p-value, leaving its weight uncertain. Adding a synthetic mean of 12 cross-factor correlations from a fourth study gave r = .079 (95% CI [-.025, .181]). This sensitivity analysis concerns a broader comparison. From this small evidence base, we cannot establish a population correlation, validate workplace cutoffs, or justify substituting self-ratings for performance scores. We identified tests of foundation knowledge (AICOS-S and GLAT) and measures of verification, reliance, trust, and dependency. We found no validated individual-level instrument in the focal corpus that tests the full combination of agent scope, permissions, recovery, state isolation, independent review, and evidence-based closure; some cover subsets. We propose a four-layer workplace battery with non-compensatory decision rules, but have not tested its thresholds or whether it improves on other assessment approaches.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-15 in cs.AI).
Categorie arXiv: Human-Computer Interaction (cs.HC) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2609.15624 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-15T22:29:03.893Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-15?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).