Newest papers

Value-Rich, Differently Organized: Measuring Value Expression and Organization in AI-Generated Debates

Maoyuan Li, Haoyuan Li, Zhongsheng Wang, Jiamou Liu · 2026 · arXiv (Cornell University)

DOI: 10.48550/arxiv.2610.28604 · cited by 0 works (OpenAlex) · open-access PDF

German

Die aktuelle Auswertung der von LLM generierten Debatten konzentriert sich hauptsächlich auf die argumentative Qualität, wobei die Wertstruktur der generierten Argumente nicht untersucht wird. Wir führen ein diagnostisches metrisches Rahmenwerk ein, um zu vergleichen, wie Werte in menschlichen Referenz- und KI-generierten Debatten ausgedrückt und organisiert werden. Das Rahmenwerk trennt die Wertexpression, den Bereich der erkennbaren Werte, die eine Debatte aufruft, von der Wertorganisation, wie diese Werte über Wende verteilt und aufrechterhalten werden. Basierend auf Schwartz's Code Basic-10-Werttheorie, repräsentiert es Debatten als mehrstufige Wertverteilung über argumentative Einheiten, Äußerungen, Positionen und vollständige Debatten, wodurch Metriken

Machine translation (Meta M2M100); the English original follows.

Abstract

Current evaluation of LLM-generated debate largely focuses on argumentative quality, leaving the value structure of generated arguments underexamined. We introduce a diagnostic metric framework for comparing how values are expressed and organized in human-reference and AI-generated debates. The framework separates value expression, the range of recognizable values a debate invokes, from value organization, how those values are distributed and sustained across turns. Grounded in Schwartz's Basic-10 value theory, it represents debates as multi-level value distributions over argumentative units, utterances, stances, and full debates, enabling metrics for value coverage, alignment, diffusion, and cross-turn dynamics. Across multiple generation systems, AI-generated debates are broadly value-expressive, often activating as many or more value dimensions than matched human references, but they organize these values differently. Their utterances are more locally value-diffuse, and source-blind judges distinguish value clarity from value focus. These findings show that debate evaluation should consider not only value presence, but also value organization. Code and supplementary materials are available at https://github.com/Maoyuan-li/Value-Expression-and-Organization.

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Topics: Value (mathematics), Argumentative, CLARITY, Epistemology, Positive economics, Metric (unit)

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange