ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:

20 results for “GUI environments”

CS papers only

Hybrid search: Keyword + semantic, ranked by combined score.ⓘ

Want pure semantic search? Try claim verification →

cs.AIEmpiricalRecentJul 16, 2026

Plover: Steering GUI Agents through Plan-Centric Interaction

Madhumitha Venkatesan, Shicheng Wen, Jiajing Guo, Jorge Piazentin Ono +2 more

Plover is a plan-centric vision-based GUI automation system that externalizes task plans and replanning as inspectable artifacts, enabling explicit supervision and localized correction.

View →
cs.AIcs.CLcs.CVEmpiricalRecentJun 9, 2026

A History-Aware Visually Grounded Critic for Computer Use Agents

Jaewoo Lee, Zaid Khan, Archiki Prasad, Justin Chih-Yao Chen +6 more

The authors introduce HiViG, a test-time framework for improving the performance of Computer Use Agents in GUI environments.

View →
cs.SEcs.AISurveyRecentAug 10, 2026

Software Engineering for and with GUI Agent

Shengcheng Yu, Yuchen Ling, Junyang Xing, Quan Zhou +2 more

This paper reviews 336 GUI-agent papers from 2018 to 2026, examining the research landscape, architectures, evaluation, software lifecycle concerns, and future opportunities.

View →
cs.DCEmpiricalRecentJul 21, 2026

A User-oriented Portable, Reproducible, and Scalable Software Ecosystem

Alfio Lazzaro, Utz-Uwe Haus, Sandrine Charousset, Nina Mujkanovic

This paper presents a software ecosystem enabling consistent development environments for running workflows across diverse hardware platforms.

View →
cs.CRcs.HCMay 1, 2026

Pick and Sort for Graphical Authentication

Argianto Rahartomo, AmirHossein Jamshidipoor, Mohammad Ghafari

The paper proposes a novel, customizable 'Pick and Sort' graphical authentication scheme where users select and arrange visual elements in a grid, demonstrating its feasibility for non-time-critical a…

View →
cs.HCcs.CLEmpiricalRecentOct 30, 2026

Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents

Haoqing Wang, Xiaoyi Zhang, Sicheng Fan, Zhexin Zhang +4 more

The paper introduces Hybrid Computer Use (HCU), a unified interface for general agents that combines programmatic, semantic, and visual interaction channels.

View →
cs.SEEmpiricalRecentJul 13, 2026

From GUI Tests to Conversational Interaction: A New Perspective on App-Specific Voice Assistants

Xue Qin, Sumesh Surendran Letha

This paper proposes an approach to automate the development of app-specific voice assistants using GUI test code and large language models.

View →
cs.CRcs.CLcs.CVApr 9, 2026

Are GUI Agents Focused Enough? Automated Distraction via Semantic-level UI Element Injection

Wenkui Yang, Chao Jin, Haisu Zhu, Weilin Luo +6 more

The paper introduces Semantic-level UI Element Injection, a novel red-teaming technique that overlays misleading UI elements onto screenshots to significantly improve the attack success rate against s…

View →
cs.SEcs.AIRecentMay 28, 2026

GUITestScape: Towards Open-set Evaluation on Exploratory GUI Testing

Xiaoyi Chen, Yifei Gao, Yang Xu, Xingxing Song +2 more

The paper introduces GUITestScape, a comprehensive benchmark for exploratory GUI testing, and GUIJudge, an open-set evaluator that significantly improves the assessment of AI agents' defect detection…

View →
cs.AIcs.CVEmpiricalRecentJul 28, 2026

Desktop-Delta Bench: Do Computer-Use Models Understand Desktop GUI Transitions?

Abhishek Pillai, Samir Kumar Nayak, Yuan Chen

This paper introduces Desktop-Delta Bench (DDB), an offline step-level benchmark for evaluating computer-use agents' ability to reconstruct causal transitions in desktop GUI environments.

View →
cs.SEcs.GTcs.PFEmpiricalRecentSep 18, 2026

Cross-Platform vs Native Mobile Development: An Empirical Study of Software Quality Trade-offs

Alexandru Ilovan

This paper compares the trade-offs of native and cross-platform mobile development frameworks.

View →
cs.CRcs.CLRecentMay 27, 2026

MaskClaw: Edge-Side Personalized Privacy Arbitration for GUI Agents with Behavior-Driven Skill Evolution

Yanqiu Zhao, Dongying Zheng, Kaibo Huang, Yukun Wei +2 more

MaskClaw is an edge-side privacy arbitrator that protects sensitive data in GUI agent screenshots by combining local visual evidence, task-specific policies, and a skill-evolution mechanism.

View →
cs.SEcs.CREmpiricalRecentJun 10, 2026

Undefined Behavior in C and C++: An Experiment With Desktop Use Cases

Jukka Ruohonen, Krzysztof Sierszecki

The paper presents an empirical experiment to study the extent of undefined behavior in C and C++ under typical desktop use of a Linux distribution.

View →
cs.SEcs.AIEmpiricalRecentOct 11, 2026

A Decade in a Day: Synthesizing Agent-Native Interfaces from Human-Oriented Software Evolution

Alan Wu, Wei Tao, Yiwen Guo

This paper develops a framework to improve the usability of desktop applications for large language model agents.

View →
cs.AIRecentMay 28, 2026

UI-KOBE: Knowledge-Oriented Behavior Exploration for Lightweight Graph-Guided GUI Agents

Yuxiang Chai, Han Xiao, Xinyu Fu, Jinpeng Chen +2 more

UI-KOBE is a framework that enhances lightweight mobile GUI agents by integrating reusable, app-specific knowledge graphs, allowing them to perform complex tasks efficiently on-device without relying…

View →
cs.SEEmpiricalRecentJun 22, 2026

The Prevalence and Impact of Licenses in Open Software Projects

Mahmoud Jahanshahi, Bogdan Vasilescu, Audris Mockus

This paper investigates the distribution of licenses in software projects and their impact on project activity.

View →
cs.LGcs.AIcs.CRMay 12, 2026

No More, No Less: Task Alignment in Terminal Agents

Sina Mavali, David Pape, Jonathan Evertz, Samira Abedini +4 more

The paper introduces the Task Alignment Benchmark (TAB) to evaluate terminal agents' ability to selectively follow relevant environmental instructions while ignoring misleading distractors, revealing…

View →
cs.SEcs.AIcs.LGEmpiricalRecentOct 20, 2026

From Code Generator to Engineering Companion: A Plant-aware Agent for PLC Programming

Joschka Kersting, Gesa Benndorf

A plant-aware conversational copilot is presented that extends the paradigm of retrieval-augmented large language models for PLC coding.

View →