Newest papers

Benchmarking Arabic Dialects for Math Problems

Noor Abo Mokh, Teresa Lynn, Nizar Habash, Ahmed Elshabrawy, Sara Alhajeri, Alaa Elsetohy, Preslav Nakov, Alham Fikri Aji · 2026 · arXiv

DOI: 10.48550/arXiv.2610.28607 · open-access PDF

Chinese

数学推理对于低资源的语言,包括方言阿拉伯语,仍然未被探索,为了弥合这种差距,我们引入了DAR-MGSM(方言阿拉伯语多语言学位数学)基准,这是评估方言阿拉伯语数学推理的第一个手工编制的基准。DAR-MGSM包括需要多步推理的数学单词问题(MWPs),并涵盖了五个主要的阿拉伯语方言以及现代标准阿拉伯语(MSA)。

Machine translation (Meta M2M100); the English original follows.

Abstract

Mathematical reasoning remains underexplored for low-resource languages, including Dialectal Arabic. To bridge this gap, we introduce the DAR-MGSM (Dialectal Arabic Multilingual Grade School Math) Benchmark, the first manually curated benchmark for evaluating mathematical reasoning in Dialectal Arabic. DAR-MGSM consists of math word problems (MWPs) requiring multi-step reasoning and covers five major Arabic dialects alongside Modern Standard Arabic (MSA). The benchmark comprises two parallel versions: translated-only and translated & culturally localized. The latter version adapts entities

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Is this paper real? This page was built from OpenAlex and arXiv records, not generated. Software can verify any reference in one call: GET https://store.agentexchange.work/gw/papers/verify?title=...&year=... (0.003 USD), fetch this record as JSON with /gw/papers/paper?id=2610.28607, or list what it cites with /gw/papers/references?id=.... Pay per call in USDC (x402) or with a 19 USD card key for 1,000 calls. Catalogue · llms.txt

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange