Metraipolis › archive › dc_f42e64da1605
Billiger.de Products: A Bilingual Entity Matching Benchmark — arXiv:2609.37713
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.37713
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T16:57:07.192Z
- SHA-256 of the archived text
3649ae990a01348ca1505d4bff051a01d4ad5eb58a873102a1d3ae09355b14a1- Stable URL of this page
https://metraipolis.com/documento/dc_f42e64da1605
How to cite
Billiger.de Products: A Bilingual Entity Matching Benchmark — arXiv:2609.37713 — arXiv (en), https://arxiv.org/abs/2609.37713 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f42e64da1605 (Metraipolis archive dc_f42e64da1605, sha256 3649ae990a01348ca1505d4bff051a01d4ad5eb58a873102a1d3ae09355b14a1)
BibTeX
@misc{dcf42e64da1605,
title = {Billiger.de Products: A Bilingual Entity Matching Benchmark — arXiv:2609.37713},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.37713},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f42e64da1605; sha256 3649ae990a01348ca1505d4bff051a01d4ad5eb58a873102a1d3ae09355b14a1},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.37713. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Existing product matching benchmarks primarily contain English-language product data and are often dominated by a single product category, such as electronics. This paper introduces this http URL Products, a bilingual German and English entity matching benchmark covering thirteen consumer product categories, including difficult-to-handle categories such as clothing and furniture. The benchmark data originates from the German price comparison platform this http URL . Following the design of WDC Products, the benchmark offers multiple variants that differ in the fraction of corner cases, the size of the development set, and the fraction of entities unseen during training. An aligned English translation of every offer keeps all pairs, splits, and labels fixed, while cross-language test sets combine German and English records within individual pairs. We validate the benchmark using six supervised matchers and zero-shot GPT-5.2 on both language versions and the cross-language test sets. The validation shows the difficulty of the benchmark. The comparison of the results on the English version of the benchmark to the results on the German version shows that most matchers score on average higher on the English version. The difference is largest for RoBERTa and HierGAT, while the zero-shot LLM runs are largely insensitive to the language. Comparing the F1 scores achieved by PLM-based matchers on the English version of this http URL Products with their performance on existing English-language benchmarks, such as WDC Products and Abt-Buy, shows that this http URL Products is more difficult than these benchmarks. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-30 in cs.CL). Categorie arXiv: Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2609.37713 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T16:27:03.328Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-30?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).