Metraipolis › archive › dc_d5b2f83fc5bb

RA-FinBERT: Rule-aware LoRA adaptation for low-resource financial sentiment classification — arXiv:2608.09834

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.09834
License (as archived)
CC0-1.0
Archived
2026-10-19T08:50:31.623Z
SHA-256 of the archived text
4fd53e63d51dc02b5c757c8e1844821841aa1847711775b9b5f45df49232af63
Stable URL of this page
https://metraipolis.com/documento/dc_d5b2f83fc5bb

How to cite

RA-FinBERT: Rule-aware LoRA adaptation for low-resource financial sentiment classification — arXiv:2608.09834 — arXiv (en), https://arxiv.org/abs/2608.09834 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d5b2f83fc5bb (Metraipolis archive dc_d5b2f83fc5bb, sha256 4fd53e63d51dc02b5c757c8e1844821841aa1847711775b9b5f45df49232af63)
BibTeX
@misc{dcd5b2f83fc5bb,
  title = {RA-FinBERT: Rule-aware LoRA adaptation for low-resource financial sentiment classification — arXiv:2608.09834},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.09834},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d5b2f83fc5bb; sha256 4fd53e63d51dc02b5c757c8e1844821841aa1847711775b9b5f45df49232af63},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.09834. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Financial sentiment analysis converts unstructured financial news into quantitative signals that can support market analysis and decision-making. Existing work on resource-efficient financial NLP has largely focused on compressing or adapting pretrained language models, with less attention to combining contextual representations with lightweight rule-derived features. This study develops Rule-Aware FinBERT (RA-FinBERT), a parameter-efficient framework that integrates low-rank adaptation (LoRA) with three continuous VADER-derived sentiment proportions (positive, negative, and neutral) and a source-level metadata feature. The standardized four-dimensional feature vector is directly concatenated with the 768-dimensional final-layer FinBERT [CLS] representation and passed through a lightweight classification head. This design introduces only 1,024 additional trainable weights relative to a structurally matched text-only FinBERT model. RA-FinBERT was evaluated against text-only FinBERT and a lightweight DistilBERT baseline for three-class sentiment classification of financial-news titles and descriptions. On the held-out test set, RA-FinBERT achieved 69.89% accuracy and a macro F1 score of 0.634, compared with 63.44% and 0.526 for text-only FinBERT. Neutral-class recall increased from 18.18% to 45.45%. The framework supports both CPU and GPU execution, offering a lightweight and practical approach to financial sentiment classification under constrained computational resources. These findings indicate that rule-derived sentiment information and source metadata can provide complementary signals to contextual FinBERT representations and improve performance with minimal additional model complexity.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-11 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL) ; Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2608.09834 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T08:49:41.946Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-08-11?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).