Metraipolis › archive › dc_59d7980102bf

On the Prospects of Dynamic LLM Conversations in Software Development — arXiv:2608.30756

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.30756
License (as archived)
CC0-1.0
Archived
2026-10-17T07:52:58.076Z
SHA-256 of the archived text
9a645dfb16ab24bf69f8d552dcd069722eb9ac35da134585e1863c2a01469979
Stable URL of this page
https://metraipolis.com/documento/dc_59d7980102bf

How to cite

On the Prospects of Dynamic LLM Conversations in Software Development — arXiv:2608.30756 — arXiv (en), https://arxiv.org/abs/2608.30756 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_59d7980102bf (Metraipolis archive dc_59d7980102bf, sha256 9a645dfb16ab24bf69f8d552dcd069722eb9ac35da134585e1863c2a01469979)
BibTeX
@misc{dc59d7980102bf,
  title = {On the Prospects of Dynamic LLM Conversations in Software Development — arXiv:2608.30756},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.30756},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_59d7980102bf; sha256 9a645dfb16ab24bf69f8d552dcd069722eb9ac35da134585e1863c2a01469979},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.30756. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large language models (LLMs) have become an essential tool for assisting developers, yet we still lack knowledge on ways to effectively support their interactions during development activities. That is, the quality of interactions with a chat-based LLM still strongly depends on how developers phrase prompts and which information they include. Our goal is to evaluate whether interventions into these interactions with LLMs have an effect on software developers---be it harmful or beneficial. To this end, we conducted a four-month longitudinal study with third-semester computer science students working on a full-stack Web development project using chat-based LLMs under three conditions: (1) a \emph{context}-aware group received intent-based conversation augmentation, (2) a \emph{proactive} group received follow-up suggestions and tailored advice, and (3) a \emph{control} group without intervention. Our augmentations are minimal: (i) to reduce confounding factors and (ii) to isolate treatment effects. Analyzing interaction logs and user surveys revealed no major differences in interaction patterns, indicating no detectable harmful effects in the measured outcomes when intervening in interactions. Moreover, we observed trends of increased satisfaction with the \emph{proactive} treatment. The results indicate that even with minimal interventions, dynamic guidance mechanisms for developer-LLM interactions show observable effects, such that more severe augmentations may have the potential to substantially improve developer satisfaction.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-01 in cs.AI).
Categorie arXiv: Software Engineering (cs.SE) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2608.30756 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T07:28:26.907Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).