Newest papers

Benchmarking Arabic Dialects for Math Problems

Noor Abo Mokh, Teresa Lynn, Nizar Habash, Ahmed Elshabrawy, Sara Alhajeri, Alaa Elsetohy, Preslav Nakov, Alham Fikri Aji · 2026 · arXiv

DOI: 10.48550/arXiv.2610.28607 · open-access PDF

Korean

이 격차를 교차하기 위해 DAR-MGSM(Dialectal Arabic Multilingual Grade School Math) 벤치마크, 다이얼렉탈 아랍어에서 수학적 추론을 평가하는 최초의 수동 큐레이션 벤치마크를 소개합니다. DAR-MGSM는 다중 단계 추론을 요구하는 수학적 단어 문제 (MWPs)로 구성되어 있으며 현대 표준 아랍어 (MSA)와 함께 다섯 개의 주요 아랍어 방언을 다루고 있습니다. 벤치마크는 두 가지 병렬 버전을 포함합니다.

Machine translation (Meta M2M100); the English original follows.

Abstract

Mathematical reasoning remains underexplored for low-resource languages, including Dialectal Arabic. To bridge this gap, we introduce the DAR-MGSM (Dialectal Arabic Multilingual Grade School Math) Benchmark, the first manually curated benchmark for evaluating mathematical reasoning in Dialectal Arabic. DAR-MGSM consists of math word problems (MWPs) requiring multi-step reasoning and covers five major Arabic dialects alongside Modern Standard Arabic (MSA). The benchmark comprises two parallel versions: translated-only and translated & culturally localized. The latter version adapts entities

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Is this paper real? This page was built from OpenAlex and arXiv records, not generated. Software can verify any reference in one call: GET https://store.agentexchange.work/gw/papers/verify?title=...&year=... (0.003 USD), fetch this record as JSON with /gw/papers/paper?id=2610.28607, or list what it cites with /gw/papers/references?id=.... Pay per call in USDC (x402) or with a 19 USD card key for 1,000 calls. Catalogue · llms.txt

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange