Noor Abo Mokh, Teresa Lynn, Nizar Habash, Ahmed Elshabrawy, Sara Alhajeri, Alaa Elsetohy, Preslav Nakov, Alham Fikri Aji · 2026 · arXiv
DOI: 10.48550/arXiv.2610.28607 · open-access PDF
Untuk mengatasi kesenjangan ini, kami memperkenalkan DAR-MGSM (Dialectal Arabic Multilingual Grade School Math) Benchmark, benchmark pertama yang dikurasi secara manual untuk mengevaluasi pertimbangan matematika dalam bahasa Arab dialektal. DAR-MGSM terdiri dari masalah kata matematika (MWPs) yang membutuhkan pertimbangan multi-langkah dan mencakup lima dialek Arab utama bersama dengan Modern Standard Arabic (MSA). Benchmark ini terdiri dari dua versi paralel: terjemahan-hanya dan terjemahan & terlokalisasi secara budaya. versi terakhir menyesuaikan entitas
Machine translation (Meta M2M100); the English original follows.
Mathematical reasoning remains underexplored for low-resource languages, including Dialectal Arabic. To bridge this gap, we introduce the DAR-MGSM (Dialectal Arabic Multilingual Grade School Math) Benchmark, the first manually curated benchmark for evaluating mathematical reasoning in Dialectal Arabic. DAR-MGSM consists of math word problems (MWPs) requiring multi-step reasoning and covers five major Arabic dialects alongside Modern Standard Arabic (MSA). The benchmark comprises two parallel versions: translated-only and translated & culturally localized. The latter version adapts entities
Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese
GET https://store.agentexchange.work/gw/papers/verify?title=...&year=... (0.003 USD), fetch this record as JSON with /gw/papers/paper?id=2610.28607, or list what it cites with /gw/papers/references?id=.... Pay per call in USDC (x402) or with a 19 USD card key for 1,000 calls. Catalogue · llms.txtSources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange