Metraipolis › archive › dc_b7b8d075ebb4
Baszta: Data-Centric Fine-Tuning of a Polish Multi-Label Safety Classifier — arXiv:2609.29266
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.29266
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-08T04:26:06.220Z
- SHA-256 of the archived text
83a758df8eb0de164e27decf9c75af9124411dcc252c74d6fef3c4bace5b111e- Stable URL of this page
https://metraipolis.com/documento/dc_b7b8d075ebb4
How to cite
Baszta: Data-Centric Fine-Tuning of a Polish Multi-Label Safety Classifier — arXiv:2609.29266 — arXiv (en), https://arxiv.org/abs/2609.29266 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_b7b8d075ebb4 (Metraipolis archive dc_b7b8d075ebb4, sha256 83a758df8eb0de164e27decf9c75af9124411dcc252c74d6fef3c4bace5b111e)
BibTeX
@misc{dcb7b8d075ebb4,
title = {Baszta: Data-Centric Fine-Tuning of a Polish Multi-Label Safety Classifier — arXiv:2609.29266},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.29266},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_b7b8d075ebb4; sha256 83a758df8eb0de164e27decf9c75af9124411dcc252c74d6fef3c4bace5b111e},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.29266. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
We develop a multi-label Polish content-safety classifier by fine-tuning allegro/herbert-base-cased (124M) across five categories (hate, vulgarity, sexual content, crime, self-harm) using a Focal + R-Drop objective, and evaluate the resulting model against Bielik Guard (Sójka) on the shared out-of-distribution Gadzi Język benchmark. Both systems are given per-category threshold tuning on the same calibration split. Under that matched protocol our model holds a small but statistically significant lead in micro F1, while an apparent macro-F1 lead does not survive: it was an artifact of comparing a tuned model against an untuned one. We also report what that micro figure is worth. Because Gadzi Język is 97% crime-positive, a classifier that flags crime on every input and nothing else already scores 0.910 micro F1 on the same test split, so micro separates neither system from a degenerate strategy and macro is the column that does. Per-category and per-protocol figures are reported in Section 4. The residual out-of-distribution gap is one of calibration rather than discrimination. Ranking quality stays high while positive probabilities collapse, and per-category temperature scaling recovers the loss where Platt scaling and isotonic regression do not. That recovery turns out to be conditional on the calibration set containing safe text. Gadzi Język contains almost none, so thresholds fitted on it flag crime on every safe input, and a balanced refit buys a deployable operating point at the cost of adversarial recall. We report both operating points rather than only the flattering one. Two changes that are standard practice, per-class cost-sensitive weighting and mean pooling, each raise in-distribution macro F1 while lowering the out-of-distribution figure, which indicates that robustness has to be selected for directly rather than inherited from in-distribution accuracy. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-25 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2609.29266 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-08T03:50:57.748Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-25?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).