Metraipolis › archive › dc_497794f1ddeb
Optimizing the Phi-2 Small Language Model for Real-time Chatbot Applications Using Parameter-Efficient Fine-Tuning (PEFT) with QLoRA Quantization — arXiv:2609.33927
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.33927
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T22:37:50.739Z
- SHA-256 of the archived text
d17740496e9def9eb56b1046335ad7983c8f4270d49643ae6d87b5c2b1157ed5- Stable URL of this page
https://metraipolis.com/documento/dc_497794f1ddeb
How to cite
Optimizing the Phi-2 Small Language Model for Real-time Chatbot Applications Using Parameter-Efficient Fine-Tuning (PEFT) with QLoRA Quantization — arXiv:2609.33927 — arXiv (en), https://arxiv.org/abs/2609.33927 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_497794f1ddeb (Metraipolis archive dc_497794f1ddeb, sha256 d17740496e9def9eb56b1046335ad7983c8f4270d49643ae6d87b5c2b1157ed5)
BibTeX
@misc{dc497794f1ddeb,
title = {Optimizing the Phi-2 Small Language Model for Real-time Chatbot Applications Using Parameter-Efficient Fine-Tuning (PEFT) with QLoRA Quantization — arXiv:2609.33927},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.33927},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_497794f1ddeb; sha256 d17740496e9def9eb56b1046335ad7983c8f4270d49643ae6d87b5c2b1157ed5},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.33927. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
This study explores the optimization of the Phi-2 Small Language Models (SLMs) for real-time chatbot applications through Parameter-Efficient Fine-Tuning (PEFT) and Quantized Low-Rank Adaptation (QLoRA). QLoRA specifically refers to the integration of PEFT with LoRA alongside a 4-bit quantization process, aimed at enhancing computational efficiency. These models, initially designed for high performance with minimal computational overhead, are further refined to address the constraints of mobile and edge computing environments. By integrating PEFT with QLoRA, the research aims to reduce memory usage significantly while maintaining, or potentially improving, the accuracy of model responses in real-time interactions. The effectiveness of these techniques was evaluated using the ROUGE metric system, which showed notable improvements in the summarization tasks performed by the models. This approach not only confirms the feasibility of using SLMs in resource-restricted environments but also opens up new avenues for deploying advanced AI-driven applications in real-time settings. The study's findings have significant implications for the development of efficient, scalable, and accessible AI technologies, paving the way for broader adoption in various industries. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.LG). Categorie arXiv: Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2609.33927 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T22:14:28.063Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).