Newest papers

The Token-Energy Law of LLM Decode: Active Bytes and Realized Time Account for Joules per Token

Chenxu Niu, Batuhan Sencer, Wei Zhang, Yong Chen · 2026 · arXiv

DOI: 10.48550/arXiv.2610.28576 · open-access PDF

Arabic

إن تطوير نموذج لغة كبيرة يحتاج إلى فهم كيفية تصميم النماذج والمعدات والمعدات، وتشكيل الطاقة لكل نقطة تم إنتاجها. نحن نقدم قانون Token-Energy، نموذجًا صناعيًا ومتعددًا من الطاقة لكل نقطة تم إنتاجها لكل نقطة تم إنتاجها للكشف عن تاريخ كامل ومتناسق. يرتبط الطاقة من النماذج بالعديد من الأبعاد الأساسية: البيتات النشطة والمعدات النشطة.

Machine translation (Meta M2M100); the English original follows.

Abstract

Energy-efficient deployment of large language models requires understanding how model architecture, hardware, and serving settings shape energy per generated token. We introduce the Token-Energy Law, a compact, interpretable model of GPU-board energy per output token for dense, full-history decoding. It relates token energy to two core dimensions: active bytes and realized decode time. Active bytes describe logical byte demand per output, separating dense weights shared within a decode iteration from private key--value (KV) histories read and updated for each request. Realized decode time is t

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Is this paper real? This page was built from OpenAlex and arXiv records, not generated. Software can verify any reference in one call: GET https://store.agentexchange.work/gw/papers/verify?title=...&year=... (0.003 USD), fetch this record as JSON with /gw/papers/paper?id=2610.28576, or list what it cites with /gw/papers/references?id=.... Pay per call in USDC (x402) or with a 19 USD card key for 1,000 calls. Catalogue · llms.txt

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange