Metraipolis › archive › dc_50efcb417a8f

GRASP: Graph-Retrieval Automated Scoring Pipeline for Label-Free Multi-Topic Essay Grading — arXiv:2609.03857

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.03857
License (as archived)
CC0-1.0
Archived
2026-10-17T02:49:27.738Z
SHA-256 of the archived text
72b17c58e54a61a60f3e19868787c81d3b2cf1ddcbc86cae7120a70a63d8f991
Stable URL of this page
https://metraipolis.com/documento/dc_50efcb417a8f

How to cite

GRASP: Graph-Retrieval Automated Scoring Pipeline for Label-Free Multi-Topic Essay Grading — arXiv:2609.03857 — arXiv (en), https://arxiv.org/abs/2609.03857 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_50efcb417a8f (Metraipolis archive dc_50efcb417a8f, sha256 72b17c58e54a61a60f3e19868787c81d3b2cf1ddcbc86cae7120a70a63d8f991)
BibTeX
@misc{dc50efcb417a8f,
  title = {GRASP: Graph-Retrieval Automated Scoring Pipeline for Label-Free Multi-Topic Essay Grading — arXiv:2609.03857},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.03857},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_50efcb417a8f; sha256 72b17c58e54a61a60f3e19868787c81d3b2cf1ddcbc86cae7120a70a63d8f991},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.03857. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Automated short-answer grading research has historically focused on exams consisting solely of questions pertaining to a single topic. Automatic grading of exams containing questions about more than one topic remains less explored. In this work, a Graph-Retrieval Automated Scoring Pipeline (GRASP) is introduced for grading label-free multi-topic science exams. Label-free exams are short-answer exams in which a student's responses to several distinct topics are merged into a single paragraph, with no markup labels or segmentation indicating which span answers which question. Reference answers for each question are encoded into a FAISS vector index via Sentence-BERT, and a semantic similarity graph is constructed over this set of reference answers. At grading time, sentence count heuristics, with a large language model used to resolve ambiguous cases, are first applied to predict how many distinct topics were answered in the student essay. This process is performed without training data or domain-specific example essays. Candidate reference nodes, each storing one (question, reference answer, concatenation of both) from the reference index, are then retrieved through cosine similarity based Retrieval-Augmented Generation (RAG) and Graph Retrieval-Augmented Generation (GRAG). GRAG operates by taking the top cosine matches as seed nodes and then performing a graph traversal over strong edges to find additional reference nodes that may have been missed by RAG. The Hungarian algorithm is then used to optimally assign one reference node per question segment such that no reference is duplicated. Each segment is then graded against its assigned reference independently using GPT-4.1-mini. This experiment is performed to show the effect of retrieval quality on grading accuracy and the benefit of graph-augmented retrieval versus strict cosine similarity methods at various levels of essay complexity.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-04 in cs.IR).
Categorie arXiv: Information Retrieval (cs.IR).
Pagina del lavoro: https://arxiv.org/abs/2609.03857 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T02:27:00.309Z dalla pagina https://arxiv.org/catchup/cs.IR/2026-09-04?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).