Human-Computer Interaction
Signals of AI Hallucination: Designing Hallucination-Aware Cues for Embodied Conversational Agents in VR
Xiaoran Yang, Yang Zhan, Xie He et al. (+5 more)
LLM-powered conversational
agents (CAs) often present uncertainty and provenance cues alongside their responses to help users assess response reliability and identify potential
hallucinations. In immersive environments such as Virtual Reality (VR), CAs often take the form of
speech-based embodied conversational
agents (ECAs), where uncertainty and provenance cues cannot rely on persistent inline text and may be missed or disrupt comprehension when delivered through
speech. We conducted a within-subjects study (N = 24) to compare three designs for presenting the
hallucination-awareness information (uncertainty and provenance) in ECAs in VR against a no-cue baseline: embodied cues using gestures and posture, icon cues using visual indicators, and text cues using color-coded text with inline citations. We evaluated how these designs affect users' ability to identify
hallucination-related information, trust in the ECA, and interaction experience (immersion and task load). Our results show that all three designs support users in identifying
hallucinations. Embodied cues were associated with higher trust and immersion, text cues offered clearer interpretability, and icon cues preserved relatively good interpretability while causing less disruption to immersion compared with embodied cues and text cues. This work contributes to the VR and AI research community by comparing different designs of
hallucination cues in immersive ECA settings and examining how they affect users' ability and experiences to identify
hallucinations. It also offers practical insights and design implications for developing future
hallucination-awareness interfaces for ECA.
Read the full abstract ▾
All authors Xiaoran Yang, Yang Zhan, Xie He, Yuxuan Huang, Yichen Yu, Zhuo Wang, Noboru Matsuda, Qiao Jin
Human-Computer Interaction
The Interface Is Downstream: Designing the Terms of Human-Agent Collaboration
Hector Ouilhet Olmos
Before an
agent responds or acts, much of the experience has already been designed.
Memory and
retrieval shape what it notices. Evidence rules shape what it may claim. Permissions shape what it can do. Learning rules shape what it carries into the next encounter. The argument comes from Alicia, a personal
agent I've built and used since January 2026. A fine-tuning pilot produced no defensible model-performance result. It exposed a provenance failure: Alicia repeated an interpretation from a retrieved synthesis, cited a source note credited by that synthesis, and left the synthesis out of the visible chain. In a model-blind review of thirty-three citations, one reviewer judged that the retrieved intermediary supplied the claim in sixteen relayed citations and part of it in four. Five of twelve citations to directly retrieved targets lacked support in the target excerpt supplied for review. These judgments remain unadjudicated, and the packet is not public. I call the shared setting a humorphic environment: a persistent computational setting that translates a human practice into software. The first Humorphism paper translated partnership. This paper translates the studio, the room where practice happens. The failure prompted an audit of
attention, evidence, action, and learning, with a review artifact and available recourse for each. The test is whether the person can inspect and contest what shaped the teammate's behavior. The output is downstream. Correction, consent, and learning carry the collaborative interface back upstream.
Read the full abstract ▾
Human-Computer Interaction
Data Patching
ATM Mizanur Rahman, Syed Ishtiaque Ahmed and Sharifa Sultana
To provide data-driven quality services to their citizens, every institution determines the acceptability of the citizen data and datafied mechanisms through institutional protocols, including preset standards and policies. However, data meeting standards at one institution might fail to meet a different institution's standards in subsequent phases of the intended citizen services due to mismatched protocols, leading to data devaluation in the citizen service ecosystem. Terming this phenomenon cross-institutional data devaluation, we investigate its causes and workarounds through interviews with 41 Bangladeshi participants. We found that traditional data auditing mechanisms cannot solely address data devaluation; hence, we draw on our findings and theory of cross-institutional AI audits to propose the Citizen-centered Cross-institutional Data Audit (CCDA). We also discuss design and policy implications of CCDA in HCI and datafied citizen services.
Read the full abstract ▾
Human-Computer Interaction
How Spatial Biologists Direct and Verify AI-Assisted Analyses
Ella Hugie, Alexandra Irger, Chiara Schiller et al. (+3 more)
Spatial biologists use visualization to assess computational analyses of tissue data. We examine how they direct and verify analyses when an AI
agent performs this work. We synthesized workflows from fourteen contextual inquiries and conducted a formative pilot followed by an observational study with ten spatial biologists using Claude Science on their own data. Participants valued help with plotting, locating
cells of interest, and tasks they found laborious or could not otherwise perform. Assessing the
agent's work involved obtaining suitable evidence, sometimes through additional work in external tools, and interpreting it using knowledge of the tissue and its markers. Scientists also sought information about ongoing computation to decide how analysis should proceed. We contribute a workflow synthesis, an empirical account of scientists directing and verifying agentic analyses, and four design directions addressing execution control, familiar interactive views, source and execution information, and accessible verification across computing setups and experience.
Read the full abstract ▾
All authors Ella Hugie, Alexandra Irger, Chiara Schiller, Lukas Hatscher, Denis Schapiro, Hanspeter Pfister
Human-Computer Interaction
Assembling, Breaking, and Refusing the Mask: Agency in AI-Mediated Self-Presentation in Livestreaming
Yang Hong, Nusrat Jahan Mim and Sharifa Sultana
Our mixed-method study examines how Chinese women livestreamers use masking to construct idealized mediated personas while navigating gendered, commercial, organizational, and platform pressures alongside personal agendas. We built on the concept of masking, analyzed 627 recruitment posts, and conducted livestream observations and interviews with 26 Chinese women streamers. We found that streamers assembled masks across bodies, AI-mediated technologies, spaces, performances, and social relations to become recognizable while protecting personal boundaries. These masks were continually negotiated, and participants sometimes broke, resisted, or refused them when demands became misaligned or unsustainable. We conceptualize masking as a sociotechnical assemblage in which agency lies in preserving, disrupting, and reconfiguring relations rather than controlling a single interface. We further theorize breaking as a consequential part of masking that exposes hidden labor and unequal costs of visibility. We offer theoretical and design directions for more negotiable, contestable, and agency-supporting AI-mediated self- presentation.
Read the full abstract ▾
Human-Computer Interaction
Understanding Creative Design Practices among Data Artists
Tianwei Ma, Anna Offenwanger and Naimul Hoque
Creative and artistic data visualizations communicate stories and invite engagement, yet how designers develop their expressive forms remains poorly understood. We investigate the design process of data artists through three complementary studies: an analysis of 40 public project accounts, artifact-anchored interviews with seven experienced data artists, and a design task-based study with eight data artists. We find that stories and visual forms develop together through data exploration, reference adaptation, sketching, and prototyping. Inspiration comes from data, existing work, everyday imagery, and personal experience. Sketches help develop mappings, while prototypes with real data can reshape representations and intended stories. Designers consider multiple possibilities but typically develop one direction at a time, partly because producing alternatives is costly. Their choices balance meaning, visual appeal, readability, and feasibility. These findings inform tools connecting stories, references, and real data, including AI assistance that supports testing and revising alternatives while preserving designers' creative judgment.
Read the full abstract ▾
Human-Computer Interaction
"A Necessary Evil": Teenagers' Sensemaking of Privacy and Safety Settings on Social Media
Jingxin Dong, Lingyun Chen, Chen Ling et al. (+1 more)
Social media platforms are embedded in teenagers' daily lives, supporting friendship and identity while exposing teenagers to unwanted contact and
privacy harms. Previous scholarship has documented how
attention capture strategies and dark patterns shape social media use, and we extend this work to better understand platform settings that ostensibly provide
privacy and safety protection. We report on think-aloud sessions with 11 teenagers aged 14 to 17 who completed six
privacy and safety tasks on Instagram, TikTok, Snapchat, and YouTube. We show how participants worked out what a setting meant through their routines, boundaries, and prior experiences, how they accommodated protections softer and less predictable than expected, and how they treated the platform as the authority on what protection should look like. We argue that feature-by-feature evaluation cannot establish whether teenagers are protected, and that platforms should carry the obligation to show that a protective action took effect and is durable.
Read the full abstract ▾
All authors Jingxin Dong, Lingyun Chen, Chen Ling, Colin M. Gray
Human-Computer Interaction
Available but Not Usable: Dark Patterns and Interaction Cost in Social Media Privacy and Safety Settings for Teens
Jingxin Dong, Lingyun Chen, Chen Ling et al. (+1 more)
Social media platforms are central to teenagers' lives, and their designs can expose users to
privacy, safety, and wellbeing harms. Platforms increasingly offer protective settings, though the presence of a control reveals little about whether teenagers can find, use, and benefit from it over time. We paired an expert evaluation of six
privacy and safety tasks across TikTok, Instagram, Snapchat, and YouTube with moderated think aloud sessions in which 11 teenagers aged 14 to 17 attempted the tasks. Interaction cost and dark patterns analysis allowed us to compare the complexity designed into each task with the effort participants incurred as they located, configured, and interpreted controls. Recurring dark patterns appeared across tasks, and most participant attempts exceeded the expert baseline. Protective settings therefore risk being insufficiently usable or durable in practice, and we propose a wayfinding audit that integrates expert evaluation, usability testing, interaction cost, and dark pattern analysis.
Read the full abstract ▾
All authors Jingxin Dong, Lingyun Chen, Chen Ling, Colin M. Gray
Human-Computer Interaction · Cross-listed from cs.RO
Talk2Escape: Conversational Grounding for Vision-and-Language Navigation
Zerui Li, Sihao Lin, Yanyan Shao et al. (+4 more)
While
Vision-and-
Language Navigation (VLN) has demonstrated remarkable success, the prevailing single-turn paradigm exposes a fundamental vulnerability:
agents operate in a strictly open-loop manner. In practice, factors such as perceptual aliasing, sensor noise, and odometry drift can cause minor deviations to accumulate over time, often leading to catastrophic mission failures with no built-in mechanism for error recovery. To address this, we introduce Talk2Escape, a proactive and model-agnostic dialogue intervention framework that reframes navigation as a closed-loop interactive process. At its core, a lightweight
vision-
language module continuously monitors
agent kinematics. Upon detecting localized looping or severe trajectory divergence, it translates raw egocentric observations into concise, grounded queries to solicit targeted corrective feedback from either an algorithmic oracle or a human-in-the-loop. Extensive evaluations in high-fidelity simulators, including R2R-CE, RxR-CE, and VLNVerse, demonstrate that Talk2Escape exhibits consistent improvements across diverse base
agents. Empirically, Talk2Escape achieves a 66.0% Success Rate on R2R-CE, outperforming the current supervised and zero-shot state-of-the-art methods. We further validate its sim-to-real transfer on a Unitree Go2 quadruped, proving that proactive dialogue drastically improves navigation robustness in physical environments.
Read the full abstract ▾
All authors Zerui Li, Sihao Lin, Yanyan Shao, Jiwen Zhang, Xiangyu Shi, Shijie Li, Qi Wu
Human-Computer Interaction · Cross-listed from cs.SE
LLM-Assisted Workflow for Structural Difference Visualization in Evolving Software Requirements
Koi McFarland and Songhui Yue
This paper presents an LLM-assisted workflow for visualizing structural differences in evolving software require- ments. Implemented in the OntologyWeb environment, the work- flow represents baseline and current requirements as triple-based semantic graphs and supports side-by-side comparison of curated graph snapshots. The comparison view aligns matched entities and uses visual encoding to highlight structural changes.
Read the full abstract ▾
Human-Computer Interaction
Open Questions Towards Skill-Sustaining Reliance in Reflective AI Engagement
Sander de Jong
As AI systems are increasingly integrated into professional work, reflection strategies such as cognitive forcing and
prompts that foster critical engagement have shown promise in reducing overreliance and improving decision quality. However, these strategies have primarily been evaluated as short-term interventions within single sessions. The next challenge is to assess whether such mechanisms sustain human agency and expertise over time. Drawing on prior work in AI-assisted decision-making, metacognition, and reflective AI engagement, we examine the challenges of designing and evaluating reflective mechanisms for long-term skill sustainability, considering individual differences in how users engage with such support, the organisational conditions under which it is implemented, and the gap between short-term evidence and long-term claims. We introduce open questions for the research community about the conditions under which reflective AI engagement can be sustained in practice.
Read the full abstract ▾
Human-Computer Interaction · Cross-listed from cs.CL
Brain-to-Language Decoding: Tasks, Signals, Methods, Evaluation, Practical Use and Beyond
Yiqian Yang, Yiqun Duan, Chenyu Liu et al. (+4 more)
Brain-to-
language decoding translates neural activity associated with
language production, internal
speech and perception into linguistic or expressive outputs. It offers a route to restoring communication after
speech loss and a means of studying how the
brain represents
language. Advances in neural recording and representation learning have expanded the field from constrained recognition and acoustic reconstruction to text generation, streaming personalised
speech and facial animation. This survey synthesises these developments across invasive and non-invasive measurements, drawing on a search without a lower year limit and source-led updates through September 2026. We connect Articulated, Inner and Perceived tasks to the neural populations they engage, the representations available to decoders and the outputs those representations can support. We examine model development, public resources and the
evolution of evaluation, and compare published performance and communication costs within their reported protocols. The synthesis identifies complementary routes to progress: phonetic, acoustic and semantic targets preserve different aspects of a message; shared representations support reuse across recording conditions and tasks; and online communication increasingly depends on calibration, feedback and user control alongside decoding accuracy. Shared
benchmarks enable algorithmic comparisons, while longitudinal studies reveal the demands of sustained use. We discuss these developments and their remaining limitations, then outline a prospective five-level trajectory from commands and
language to meaning, scenarios and bidirectional cognitive exchange
Read the full abstract ▾
All authors Yiqian Yang, Yiqun Duan, Chenyu Liu, Yiqi Wang, Xinliang Zhou, Chin-Teng Lin, Yu Zhang
Human-Computer Interaction
ViMoWear: Visual Motion-Guided sEMG-IMU Representation Learning for Subject-Independent Thumb Gesture Recognition
Wenjuan Zhong, Chenfei Ma and Kianoush Nazarpour
Wearable sensing enables intuitive hand gesture recognition for human–computer interaction, augmented reality, and prosthetic control, yet subject–independent recognition remains challenging because wearable signals provide only indirect and highly subject-specific observations of hand motion. Although visual information can improve wearable gesture recognition, requiring it during inference increases sensing complexity and limits practical deployment. We propose ViMoWear, a visual-motion-guided framework that leverages synchronized 3D hand motion as training-only supervision while requiring only wearable sensing for gesture classification at inference. Specifically, Motion-Guided Cross-Subject Contrastive Learning (MGCL) promotes subject-robust representations, and Thumb-Aware Masked Motion Reconstruction (TMMR) preserves fine-grained motion information. The leave-one-subject-out experiments on a synchronized sEMG–IMU–pose
dataset demonstrate consistent improvements over supervised baselines across multiple sensing configurations, while the learned representations also support classifier-free
retrieval. The proposed training-only visual motion supervision improves the generalization of wearable representations to unseen subjects.
Read the full abstract ▾
Human-Computer Interaction · Cross-listed from cs.MM
When Visual Quality Misleads: Intent Recognition under Rendered Avatar Distortions
Ning-Hsuan Chang, Kai-Siang Ma and Yu-Chih Chen
Avatar-streaming systems are commonly evaluated with image and
video quality assessment (IQA/VQA) metrics, implicitly treating visual fidelity as a proxy for communicative success. We test this assumption through a controlled behavioral study of rendered 3D avatars across a pristine condition and fourteen
geometric, photometric, temporal, and combined distortions. Fifty-nine participants contributed 2,688 judgments of perceived action, response confidence, and visual quality. We identify Misleading Quality in this
dataset as distorted renderings that retain above-average perceived quality but yield below-average action-recognition accuracy. We also derive an Intent Quality Score (IQS) combining recognition correctness and confidence as the behavioral target for objective metrics. Among 126 distorted content–condition
cells, 31 (24.6%) exhibited Misleading Quality; temporal and
geometric distortions showed the highest rates, at 50.0% and 31.1%, respectively. The results reveal a quality–accuracy dissociation where distortion families affect appearance and communication differently. Across 24 direct-scoring IQA/VQA metrics and three supervised feature-regression baselines,
alignment with IQS remained limited; at $\lambda=0.5$, the best leave-one-content-out baseline reached PLCC $=0.4435$. Under this controlled protocol, visual fidelity alone is insufficient for avatar communication, motivating intent-aware quality assessment and streaming objectives.
Read the full abstract ▾
Human-Computer Interaction
Forced Yet Free: What Magicians' Forcing Reveals Beyond Intentional Binding
Koichi Toida
In magicians' forcing, spectators may experience a choice as self-determined even when that choice has been externally directed. Research on the sense of agency has developed largely around action-outcome relations, most notably intentional binding; however, the problem of choice authorship (why a particular choice is experienced as originating from oneself) must be treated as distinct. This paper integrates research on agency and forcing by distinguishing the locus of intervention within the choice-action-outcome chain, self-attribution at the Decision, Action, and Outcome levels, and the processes by which feeling of agency and judgment of agency are constructed. On this basis, a distinction is drawn between intentional binding, which concerns the temporal/causal relation between action and outcome, and the different binding problem exposed by forcing: the relation between a choice and its author. This theoretical relation is termed authorship binding. Authorship binding does not denote a new implicit measure; rather, it refers to the constructive relation through which a choice whose formation has been directed by external factors can nevertheless be experienced as originating from the self. Forcing can sustain this relation not by eliminating agency, but by selectively preserving, substituting, and redistributing agency cues. XR, in which body-centred spatial relations can be manipulated, is further conceptualised as a medium for extending the forced-yet-free structure into space.
Read the full abstract ▾
Human-Computer Interaction · Cross-listed from cs.SD
Psychoacoustically Aligned Latent Smoothing for Adversarial Robustness of Full-Duplex Speech-to-Speech Dialogue Models
Kian Shamsaie and Iman Modarressi
End-to-end
speech-to-
speech dialogue models listen and speak simultaneously, so a continuously open acoustic channel is exposed to
adversarial manipulation. We formalize imperceptible attacks on full-duplex
agents as optimization over additive perturbations confined beneath the psychoacoustic masking threshold of the carrier
speech, under three goals: targeted semantic hijacking, response suppression, and policy jailbreaking. Against an undefended Moshi-style
agent, white-box attacks succeed in up to 91.7% of trials. We then introduce psychoacoustically aligned latent smoothing (PALS), which injects anisotropic Gaussian noise shaped by local codebook covariance at the residual-vector-quantized latent interface, with input noise shaped by the masking threshold constraining the attacker and trained by a Kullback–Leibler consistency objective. Deployed with no inference-time cost, PALS reduces hijack to 8.3%, mute to 11.2%, and jailbreak to 9.1% at clean quality within 2.3%. A Monte Carlo-smoothed variant certifies an ellipsoidal latent radius up to 0.616, a guaranteed floor that the empirical robustness far exceeds.
Read the full abstract ▾
Human-Computer Interaction · Cross-listed from cs.CL
Neither Silence nor Overlap Is Failure: Intent-Conditioned Evaluation of Turn-Taking in Full-Duplex Spoken Dialogue Models
Kian Shamsaie and Iman Modarressi
Benchmarks for full-duplex spoken dialogue models score turn-taking with binary fixed-window rules that reward immediate response or silence by completeness of the prior turn. We argue that the appropriateness of a response offset, whether delayed silence or anticipatory overlap, is conditional on the speaker's latent intent, identifiable only from that speaker's behavior. We introduce TACT, a
benchmark of 9,728 episodes and 73.2 hours from five dyadic corpora; each episode carries dialogue history, a per-speaker
memory profile, and an annotator-derived posterior over six intent classes. Scoring replaces binary windows with a strictly proper threshold-weighted continuous ranked probability score whose weights are intent-conditioned timing kernels fitted to human floor-transfer-offset distributions, proving boundedness, consistency, and binary reduction. Across eleven systems the best model reaches 0.47 against a human topline of 0.86, is nearly invariant to speaker profiles, and TACT agrees with human judgments at Spearman 0.81 versus 0.46 for binary metrics.
Read the full abstract ▾
Human-Computer Interaction
ASAP: Visual Analytics for Identifying and Analyzing Image Patterns in AI-generated Images
Jinbin Huang, Yuki Ueno, Chen Chen et al. (+4 more)
Generative image models can produce highly realistic images, raising concerns about potential misuse in creating deceptive content. Current deepfake approaches face several challenges, including limited generalizability, lack of interpretability, and poor actionability. To help address these, we present ASAP, an interactive visualization system designed to empower users in the analysis and summarization of deceptive patterns in AI-generated images. ASAP introduces a novel CLIP-adapted image encoder that generates interpretable representations, enabling the extraction of influential pixel regions via calculated masks. This approach facilitates the identification of key deceptive features through influence measurement techniques. These backend techniques are integrated into a visual analytics dashboard that allows users to quantify and analyze authenticity-indicative patterns in image collections containing both authentic and AI-generated images. This approach also supports the comparative analysis of various generative models, including GANs and
diffusion models. We demonstrate ASAP's efficacy through a user study and two application scenarios using established fake image detection
benchmarks, showcasing its ability to effectively extract and quantify deceptive patterns.
Read the full abstract ▾
All authors Jinbin Huang, Yuki Ueno, Chen Chen, Aditi Mishra, Bum Chul Kwon, Zhicheng Liu, Chris Bryan
Human-Computer Interaction · Cross-listed from cs.CV
Can Vision-Language Models Analyze Human-Centered Video? Mapping Model Capabilities and Human-AI Collaborative Workflows
Xiyuan Shen, Jiuyang Lyu, Seokhyun Hwang et al. (+4 more)
Video provides a rich record of human behavior, interaction, and situated contexts, offering important evidence for understanding people and conducting human-centered research. As
vision-
language models (VLMs) become increasingly capable of analyzing
video, they offer opportunities to automate this traditionally human-intensive process. Yet a central question remains: when can VLMs analyze human-centered
video independently, and when does reliable analysis still require human involvement? To address this question, we first characterize
video analysis practices in human-centered research. We systematically analyze all 1,702 CHI 2026 full papers and identify 125 that annotate
videos. Through iterative coding, we derive a five-dimensional taxonomy spanning analytic purpose, viewpoint, phenomenon,
reasoning requirement, and annotation authority. Grounded in recurring annotation tasks captured by this taxonomy, we construct a
benchmark of 15 representative tasks from open
datasets to map the capabilities and limitations of a general-purpose VLM. We examine the division of labor between humans and VLMs by comparing three annotation workflows: VLM alone, human alone, and human verification of VLM outputs. Across tasks, VLM-alone annotation approaches human accuracy on average (HNS = 97.0, where 100 denotes human-alone performance), demonstrating substantial potential to automate human-centered
video analysis. Human verification achieves the highest accuracy (HNS = 121.5) while reducing human annotation time by 48.9% and monetary cost by 31.3%-44.5% relative to human-alone annotation. Our findings connect real-world human-centered
video analysis tasks and current VLM capabilities, and clarify how human-AI collaboration can make VLM-assisted analysis reliable and efficient.
Read the full abstract ▾
All authors Xiyuan Shen, Jiuyang Lyu, Seokhyun Hwang, Huanfen Yao, Shwetak Patel, Zhihan Zhang, Jacob O. Wobbrock
Human-Computer Interaction
Listening and Mirroring: The Effects of Verbal Attunement and Behavioral Mimicry on Social and Empathic Perceptions of Embodied AI Agents in VR
Nathalia Gomez, Haig Shamlian, Omar Khan et al. (+1 more)
As embodied
agents take on increasingly social and relational roles in VR, visual realism and embodiment alone may be insufficient; users must also perceive these
agents as emotionally attuned, supportive, and humanlike. Prior work suggests that verbal attunement and nonverbal mimicry can each improve users' social evaluations of embodied
agents. However, behavioral mimicry has largely been studied outside of real-time, conversational AI interactions, leaving limited understanding of how users respond when an
agent simultaneously generates contextually responsive dialogue and adapts its nonverbal behavior during an immersive conversation. To address this gap, we developed an embodied AI counselor that combines conversational AI with real-time facial-expression and posture mimicry, while producing either verbally attuned or neutral responses. We evaluated the system in a 2 X 2 within-subjects study with 20 participants, manipulating verbal attunement and behavioral mimicry. Results showed that verbal attunement was the most reliable driver of perceived empathy. Behavioral mimicry showed a marginal relationship with perceived humanness, while greater mimicry exposure showed preliminary, exploratory positive associations with empathy, positivity, and humanness, particularly among female participants. Together, these findings show that
multimodal synchrony is not a simple additive strategy for designing empathic conversational
agents in VR and underscore the need to consider how verbal and nonverbal behaviors are combined during real-time interaction.
Read the full abstract ▾
All authors Nathalia Gomez, Haig Shamlian, Omar Khan, Tiffany D. Do
Human-Computer Interaction
CoBranchMR: Supporting Parallel Design and Conflict Resolution in Mixed Reality
Niloofar Sayadi, Kaiyuan Tang, Yunhao Xing et al. (+3 more)
We present CoBranchMR, a mixed reality (MR) system that enables distributed collaborators to work in parallel from different locations on the same digital representation of a physical object. CoBranchMR lets users branch an object into editable virtual copies, customize them independently, and then merge their work back into a shared object. When merging copies, the system displays potential conflicts on the object's surface and provides several resolution options. By adopting branch-and-merge workflows for embodied spatial collaboration, CoBranchMR introduces a new collaborative interaction model that supports parallel design, conflict resolution, and negotiation in remote creative work.
Read the full abstract ▾
All authors Niloofar Sayadi, Kaiyuan Tang, Yunhao Xing, Simret Gebreegziabher, Chaoli Wang, Diego Gomez-Zara