Human-Computer Interaction
TransCAVE-E: A distributed virtual reality testbed for adaptive external human-machine interfaces
Yun Ye, Zexuan Li, Haoyang Liang et al. (+3 more)
External human-machine interfaces (eHMIs) are evolving from predefined displays toward adaptive communication strategies that respond to changing traffic and road-user states. This transition requires experimental infrastructure that supports human-in-the-loop (HIL) interaction, software-in-the-loop (SIL)
algorithm execution, reusable experiment orchestration, and synchronized
multimodal human-factors evaluation. This paper presents TransCAVE-E, a distributed virtual-reality testbed for developing and validating adaptive and intelligent eHMIs. The platform integrates three coupled modules: a Scenario Design Center for configurable traffic environments and experimental conditions; an eHMI
Algorithm Module for bidirectional real-time coupling between simulation and external
algorithms; and a Data Management System that synchronizes trajectories, eye-tracking, physiological, system-log, and subjective data. A distributed multi-
agent architecture supports synchronous interaction among pedestrians, human drivers, automated vehicles, and other traffic entities. Two use cases demonstrate the platform. In an AV-pedestrian experiment, an intent-recognition-based eHMI improved decision efficiency by 12.8% and 13.0% in yielding and non-yielding scenarios, reduced gaze distraction by 17.1% in the yielding scenario, and reduced unnecessary
prompts by 40% in the non-yielding scenario while maintaining interaction safety. An HV-AV study further demonstrated real-time SIL validation of a game-theoretic information-disclosure strategy under active driver interaction. TransCAVE-E provides an extensible and reproducible infrastructure for closed-loop evaluation and iterative refinement of intelligent human-vehicle communication strategies.
Read the full abstract ▾
All authors Yun Ye, Zexuan Li, Haoyang Liang, Boya Sun, Jian Sun, Haotian Shi
Human-Computer Interaction · Cross-listed from cs.CL
The Role of AI in Online Reviews
Valeria Lerman, Oren Rigbi and Yaniv Dover
The rapid adoption of large
language models (LLMs) creates new opportunities for strategic content generation on online platforms, including potentially harmful forms of manipulation that may undermine platform effectiveness and reshape platform dynamics. However, measuring such activity is difficult because AI-generated content is rarely directly observable. We introduce an empirical approach that leverages discrete LLM supply shocks - abrupt changes in model prices and capabilities, and contrasts verified with non-verified reviews to identify changes in platform activity associated with generative AI supply improvements. We apply this approach to more than 13 million reviews from Trustpilot, one of the leading online platforms for business reviews. A robust finding is that following LLM supply shocks, unverified reviews shift toward greater negativity: more 1-
stars, fewer 5-
stars, and lower ratings, with effects driven primarily by new model releases and concentrated among firms with the lowest and highest review volumes, suggesting that strategic AI use may reshape platform competition dynamics. We further find that LLM supply shocks trigger short, concentrated bursts of review activity. Together, these findings suggest that generative AI is already reshaping how reputation and competition operate on online platforms.
Read the full abstract ▾
Human-Computer Interaction · Cross-listed from cs.CY
AMINA: The Inclusive and Accountable AI for Marginalized Immigrant Nonprofit Assistance
Maryam Mokhberi, Dipto Das and Syed Ishtiaque Ahmed
Immigrant-led nonprofit groups, particularly those operating in politically sensitive contexts, face exclusion from formal registries and digital platforms. This paper reports a three-phase mixed-methods study with Iranian immigrant nonprofit practitioners: 27 semi-structured interviews, a co-design session, and 7 evaluation and feedback interviews on a prototyped AI assistant, AMINA. Our findings highlight how legitimacy barriers, capacity gaps, and politically charged misinformation constrain nonprofit operations. We translate these insights into design goals for an inclusive nonprofit AI assistant: support for everyday group operations, recognition of informal nonprofit efforts, proactive countering of misinformation, and multilingual, accessible interaction. User evaluations show AMINAs potential to reduce reporting burdens and foster transparency through proactive reminders, and catalyze collaboration across dispersed networks. We contribute to CSCW and HCI by characterizing the cooperative work of transnational immigrant nonprofits, extending scholarship on informality and misinformation, and demonstrating how AI can act as a collaborative partner that strengthens, rather than displaces, the human connections at the core of nonprofit ecosystems, while also posing major risks.
Read the full abstract ▾
Human-Computer Interaction
Occlusion-induced risk and interventions in pedestrian-autonomous truck interactions on multi-lane roads: A virtual reality study
Yun Ye, Yuan Che, S.C. Wong et al. (+2 more)
Autonomous trucks (ATs) may introduce distinct pedestrian-safety risks because of their large physical dimensions, constrained braking capability, limited driver-based communication cues, and potential to occlude surrounding traffic. This study employed a controlled virtual reality experiment with 54 participants to investigate pedestrian-AT interaction risk in an unsignalized multi-lane crossing scenario and to evaluate occlusion-targeted risk mitigation strategies. The experiment examined the effects of near-side vehicle type, weather condition, and far-side vehicle yielding strategy on pedestrian behavior, perceived risk, and objective safety. Based on a representative high-risk scenario, three targeted interventions were designed and tested: an environment-aware external human-machine interface (eHMI), a projected eHMI, and an auditory warning. The results showed that ATs increased perceived risk and encouraged more cautious crossing behavior, suggesting a risk-compensation effect. However, this compensation was weakened under rainy conditions, where braking-related safety margins were reduced. AT-induced occlusion further increased far-side interaction risk by limiting pedestrians' recognition of hidden vehicles. Among the three interventions, the projected eHMI showed the best overall performance, improving objective safety margins, enhancing risk awareness, and supporting behavioral adjustment. These findings highlight the need for AT-specific interface and warning strategies that address both intention communication and risk localization.
Read the full abstract ▾
All authors Yun Ye, Yuan Che, S.C. Wong, Stergios-Aristoteles Mitoulis, Haoyang Liang
Human-Computer Interaction
Looking Around by Looking Around: Omnidirectional Gaze-based VR Viewport Control
Hock Siang Lee, Jinghui Hu, Florian Weidner et al. (+2 more)
Traditional VR viewport control primarily relies on head and torso movement, which can be effortful and limiting in both constrained and extended-use settings. We introduce Looking Around by Looking Around (LALA), a gaze-based VR pitch-and-yaw viewport control technique designed for natural and effortless omnidirectional exploration via eye movements, without requiring or obstructing movement of the head, hand, or body, offering a low-effort and highly accessible interaction method. Because gaze is primarily used for perception and exhibits oculomotor and perceptual asymmetries, using it directly for control is difficult. To address this, we designed an asymmetric omnidirectional control profile for the eye, then built on it to exploit tendencies for eyes to stay within comfortable regions for viewport control. We evaluated LALA in a user study (N=18) featuring two contrasting tasks:
alignment towards known directions and open-ended visual search towards unknown directions. LALA was strongly preferred over the traditional baseline, achieving competitive performance while enabling fully hands-free interaction with minimal physical movement.
Read the full abstract ▾
All authors Hock Siang Lee, Jinghui Hu, Florian Weidner, Haopeng Wang, Hans Gellersen
Human-Computer Interaction
Multimodal Takeover Requests for Drivers with Hearing Loss: Implications for AI-Enabled Communication in Automated Vehicles
Aries Chu, Wei-Hsiang Lo and Gaojian Huang
More than 430 million people worldwide live with disabling hearing loss. Although people with hearing loss are legally permitted to drive and may benefit from conditionally automated vehicles, SAE Level 3 systems still require drivers to respond to takeover requests when automation reaches its limits. Existing takeover requests often rely on auditory information, yet little evidence addresses visual and tactile designs for drivers who cannot rely on sound. This driving-simulator study with 40 participants examined the effects of information type (instructional, informative, and baseline), signal type (visual, tactile, and visual-tactile), and hearing condition (normal hearing and simulated hearing impairment) on takeover performance. Information type significantly affected reaction time, with baseline displays producing the shortest times. Signal type significantly affected reaction and takeover time, with visual-tactile displays producing the shortest times. The interaction between signal type and information type was significant for all three measures. Visual-tactile displays produced the shortest reaction times within every information type. With visual-tactile signaling, simple baseline alerts prompted the fastest reactions and the most abrupt maneuvers, whereas informative content produced the lowest mean maximum resulting acceleration. Hearing condition showed no significant main effect on any measure. These findings suggest that AI-enabled vehicles can support urgent takeover communication through visual-tactile displays and can adapt message content to the time available and the maneuver quality required, with implications for drivers across hearing abilities.
Read the full abstract ▾
Human-Computer Interaction
A Cyber-Physical Machine Tool Framework with a Real-Time Machining Process Digital Twin
Khalil Chakal, Tero Kaarlela, Jose Outeiro et al. (+1 more)
Digital Twins (DTs) have emerged as a key technology for improving the monitoring, optimization, and automation of manufacturing systems. However, existing Cyber-Physical Machine Tool (CPMT) implementations primarily represent the machine tool, while the machining process remains only partially synchronized with its physical counterpart. This paper extends a previously presented CPMT framework by introducing a hierarchical DT framework that simultaneously maintains DTs of both the machine tool and the machining process. The proposed framework integrates real-time CNC operational data, a voxel-based workpiece representation, synchronized process vibration measurements, and a persistent part DT repository for process replay, traceability, and future synthetic data generation. Experimental evaluation demonstrated real-time operation at a 20 Hz machining-state update rate, interactive visualization exceeding 100 frames per second, and a mean depth reconstruction error of 0.16 mm. The implementation provides a foundation for AI-assisted machining applications while preserving the machine tool monitoring and teleoperation capabilities.
Read the full abstract ▾
All authors Khalil Chakal, Tero Kaarlela, Jose Outeiro, Carlos Andrade
Human-Computer Interaction
The Policy Deficit in AI x Social-Emotional Learning Research
Tran Van Cuong, Liu Yihan and Nguyen Van Tuong
As artificial intelligence (AI) is increasingly integrated into social-emotional learning (SEL) initiatives, the need for evidence-based policy has become paramount. We systematically reviewed 65 peer-reviewed papers that examine the intersection of AI and SEL to investigate how these studies articulate policy implications. Our analysis revealed a substantial "policy deficit" in the current AI x SEL literature: nearly three-quarters of the studies did not mention policy implications at all. Using the "WH-question" framework (Who, What, Why, When/Where, and How), we map the policy implications narratives present in the literature and show that they often lack the specificity and actor-oriented guidance required for effective evidence-informed policymaking. We find a significant association between publication venue and policy engagement, suggesting that current academic incentive structures may prioritize technical innovation and pedagogical feasibility over explicit engagement with governance and regulation. This study identifies a "techno-solutionist" trap, where technical potential is foregrounded while the institutional conditions for responsible implementation remain under-specified. We conclude by proposing a shift from "implication-as-afterthought" to "implication-as-methodology" and offer a set of actionable guidelines for researchers, editors, reviewers, and policymakers to bridge the gap between AI innovation and educational governance. Rather than presenting policy as a generic ethical horizon, we argue that AI-SEL studies should systematically specify Who should act, What actions are recommended, Why these actions are needed, When and Where they apply, and How strongly they are framed, thereby strengthening the translation of AI x SEL innovation into educational policy and practice.
Read the full abstract ▾
Human-Computer Interaction · Cross-listed from cs.LG
HoopMind: A Real-Time Neural Game-Tree System for Opponent-Aware Possession Planning
Yibo Gong, Cong Guo and Jiacheng Ding
School coaches prepare for opponents with game film and intuition. The analytics tools of professional teams stay out of reach. We ask how far public data can close this gap. Professional basketball is our case study, chosen for its data rather than the league. We fuse five public sources into one per-shot
dataset of 4.23M shots over 21 seasons. The sources are shot locations, two play-by-play feeds, official matchup tracking, and player biometrics.
Alignment across them is 99.5% to 100%. We also report two data pitfalls that are easy to miss. We then model a half-court possession as a sequential game. Shot values come from ShotNet, an
embedding multilayer perceptron (MLP). On a held-out season it beats a zone-rate baseline and a logistic baseline, and its probabilities are well calibrated. A depth-limited expectimax search then solves the offensive decision tree, with branch-and-bound
pruning to keep it real time. All training runs offline, so the online system stays light. A scouting planner and a playable simulator both run in a single browser page.
Read the full abstract ▾
Human-Computer Interaction
Towards Effective Generation of Interactive Visualizations with Vibe Coding: An Empirical Study
Yanshan Zeng, Ruixuan Tu, Zuo Xiang et al. (+3 more)
Constructing interactive visualizations has traditionally required substantial human effort, involving both technical implementation and design decision-making. Recently, vibe coding, a programming paradigm leveraging Large
Language Models to generate, interpret, and refactor code from natural
language specifications, has emerged as a promising approach to reduce the burden. However, the capabilities and limitations of vibe coding in building interactive visualizations remain unexplored. To address this gap, we conducted a user study with 78 participants that were tasked with constructing interactive visualizations using vibe coding. We further collected users feedback through questionnaires, interviews, and case analyses. Based on this study, we examine (1) the capabilities and (2) user experience of vibe coding in generating interactive visualizations, and (3) the practical human-
agent collaboration strategies adopted. Our findings provide the first systematic assessment of vibe coding for interactive visualization construction, revealing both its strengths and limitations, explaining the shift in developer labor and identifying the hybrid collaboration strategies participants adopted. Furthermore, our study offers insights for more intuitive and robust vibe coding practices.
Read the full abstract ▾
All authors Yanshan Zeng, Ruixuan Tu, Zuo Xiang, Lijia Feng, Guozheng Li, Chi Harold Liu
Human-Computer Interaction · Cross-listed from cs.CR
Context or Digits? Balancing Memorability and Efficiency in Virtual Reality Authentication
Yuxuan Huang, Qiao Jin, Tongyu Nie et al. (+2 more)
We present Adaptive Direction-Based Authentication (ADBA), a knowledge-based authentication method for Virtual Reality that decouples users' needs temporally by enforcing password creation based on virtual environment context while supporting both context- and digit-based entries during authentication. This design prioritizes memorability for new passwords and offers both efficient and memorable options to support users' evolving needs. We conducted a remote longitudinal study with 66 participants comparing ADBA against 6-digit PINs over 2-3 weeks. The results demonstrated that ADBA achieved superior memorability and lower perceived task load. Interestingly, no participant chose to enter via digits in the study, yet they still perceived ADBA to be highly efficiency despite longer objective entry times. ADBA also provided security benefits through randomly-generated digit representations, though some degree of password homogeneity was observed in specific virtual environments. Our findings suggest that ADBA offers solid advantages to the traditional PINs, and successfully addresses the tradeoffs between efficiency, memorability, and security under the usage scenarios considered in the study.
Read the full abstract ▾
All authors Yuxuan Huang, Qiao Jin, Tongyu Nie, Victoria Interrante, Evan Suma Rosenberg