Metraipolis › archive › dc_f0ecdaa320f9

An Integrated Vision-and-Language Pretraining (VLP) and Visual Question Answering (VQA) model to Automate Nondestructive Evaluation Image Analysis — arXiv:2608.29408

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.29408
License (as archived)
CC0-1.0
Archived
2026-10-17T08:39:49.306Z
SHA-256 of the archived text
e343a083085f9f00cfdeffc1bbdc90e262946ac741812fa925238c663e56eee3
Stable URL of this page
https://metraipolis.com/documento/dc_f0ecdaa320f9

How to cite

An Integrated Vision-and-Language Pretraining (VLP) and Visual Question Answering (VQA) model to Automate Nondestructive Evaluation Image Analysis — arXiv:2608.29408 — arXiv (en), https://arxiv.org/abs/2608.29408 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f0ecdaa320f9 (Metraipolis archive dc_f0ecdaa320f9, sha256 e343a083085f9f00cfdeffc1bbdc90e262946ac741812fa925238c663e56eee3)
BibTeX
@misc{dcf0ecdaa320f9,
  title = {An Integrated Vision-and-Language Pretraining (VLP) and Visual Question Answering (VQA) model to Automate Nondestructive Evaluation Image Analysis — arXiv:2608.29408},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.29408},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f0ecdaa320f9; sha256 e343a083085f9f00cfdeffc1bbdc90e262946ac741812fa925238c663e56eee3},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.29408. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

An AI-based approach called ChatNDE Figure to Caption is introduced, which aims to automate the interpretation of NDE images using deep learning and natural language processing (NLP). A Vision-and-Language Pretraining (VLP) strategy is developed to help the model learn how to connect visual features with meaningful language. Basically, we built a large NDE image dataset, trained the model using annotated examples, and then evaluated how well it performed using BLEU scores to compare its output to expert written descriptions. So, the system combines a ResNet50 model to extract important features from the images and a GPT2 language model to turn those features into natural sounding text. Even though the accuracy of the model has been low the generated caption results have been solid so far, the captions were shorter but mentioned some important features of images what human experts would say, which shows the model is learning to pick up on key details. Also, a Visual Question Answering (VQA) model is used as part of the system. VQA models are designed to take an image and a question about that image (like Is there a crack? or Where is the defect located?) and generate a useful answer. By adding this layer, the platform will not just describe what it sees, it can also respond to specific questions, making it even more interactive and helpful for inspectors in the field. This whole approach is a big step toward speeding up NDE workflows, reducing human error, and making the technology more accessible.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-01 in cs.LG).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2608.29408 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T08:13:26.908Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).