Newest papers

Step-Aligned Script Generation with Verification and Recovery for Web Automation Testing

Hridya Dhulipala, Xiaokai Rong, Aashish Yadavally, Tien N. Nguyen · 2026 · arXiv (Cornell University)

DOI: 10.48550/arxiv.2610.25601 · cited by 0 works (OpenAlex) · open-access PDF

Chinese

自动生成高效的端到端 Web 测试仍然是昂贵的:开发人员必须识别稳定的选择器,编码多步工作流,附加声明,并保持脚本随着接口的演变。 最近的基于 LLM 的 Web 代理人可以在直播浏览器会话中完成自然语言的任务,但任务完成并非相同,即制作可执行代码、目标状态声明和可重复状态的代码,可由开发人员进行互动评估,并与口语相关。我们介绍TESSARA,一个适应性的测试脚本生成框架,可将自然语言的测试意图转换为Playwright地面脚本,包括可执行代码、目标状态声明和步骤级公共链接到其生成的代码片段,选择器证据,执行结果和修复历史。我们提出

Machine translation (Meta M2M100); the English original follows.

Abstract

Automated generation of end-to-end web tests remains costly: developers must identify stable selectors, encode multi-step workflows, attach assertions, and maintain scripts as interfaces evolve. Recent LLM-based web agents can complete natural-language tasks in a live browser session, but task completion is not the same as producing a test-ware artifact - code that is executable, replay-able from a reset state, inspectable by developers, and tied to an oracle. We present TESSARA, an adaptive test-script generation framework that converts natural-language test intent into Playwright scripts consisting of executable interaction code, goal-state assertions, and step-level provenance linking each step to its generated code fragment, selector evidence, execution outcome, and repair history. TESSARA grounds each planned step via Step-Aligned Scripting (SAS), enabling fine-grained failure localization, selective regeneration of failing suffixes, and reversibility-aware backtracking that avoids undoing likely commit points (e.g., form submissions). A three-level verification pipeline (syntactic, execution, and semantic/oracle), detects and repairs malformed code, interaction failures, and incorrect landing states. We evaluate TESSARA on three public web benchmarks, measuring script executability, oracle satisfaction, replay stability, and repair efficiency, and show substantial improvements over baselines and underlying VLMs used directly as script generators.

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Topics: Computer science, Scripting language, Commit, Executable, Web application, Programming language

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange