Computers and Society
Who Judges the Frame? Auditing Multimodal LLM Judges for News Framing Across Event-Level Perspectives
Antonela Tommasel and Markus Schedl
News coverage of major world events is shaped not only by what is reported, but also by how events are framed through text, images and their combination. At the same time, Large
Language Models (LLMs), including
multimodal LLMs, are increasingly used as scalable instruments for analysing framing, sentiment, ideological slant and perspective differences in
multimodal media
datasets. This creates a methodological challenge. When used as measurement instruments, LLM outputs may reflect not only content properties, but also model-specific tendencies,
prompt design choices, and social, political, cultural, linguistic or modality-specific assumptions. This work audits LLMs as instruments for large-scale framing and perspective analysis in
multimodal news coverage. Using an event-centered
dataset of 2025–2026 news coverage, where each event includes left-, center- and right-oriented articles about the same headline, we combine
embedding-based measures of within-event viewpoint similarity with model-based assessments of framing constructs across modality-specific and metadata-visible input conditions. Rather than treating either
dataset labels or model outputs as ground truth, our goal is to examine the usefulness and limitations of LLM-based media analysis. The study contributes an audit protocol that highlights the need to report modality effects, metadata sensitivity, and
prompt-induced artifacts alongside substantive claims about news framing and ideological viewpoint differences.
Read the full abstract ▾
Computers and Society
From Voice to Leverage in Data Governance. Building Enforceable Social License for Data ReUse
Stefaan G. Verhulst, Adam Zable, Begona Gonzalez Otero et al. (+1 more)
Contemporary data governance has converged on participation. Citizens assemblies, deliberative polls, codesign workshops, and community advisory panels are now routinely suggested to build trust and secure a social license for the reuse of data. Yet this consensus rests on an unexamined assumption: that giving affected communities a voice will, on its own, change what data holders do. This paper argues that the field needs to complement voice with leverage: the capacity of individuals and communities to make their participation consequential by attaching credible legal, institutional, contractual, economic, or reputational costs to being ignored. Drawing on labor relations bargaining theory, the sociology of disputes, and James C. Scott's account of legibility, we develop leverage as an analytic category defined by three properties: it is counterfactual, enforceable, and durable. We further argue that leverage presupposes epistemic legibility affected publics can rarely impose costs on a system they cannot see, document, or contest; and that most existing transparency instruments equip regulators and procurers rather than the governed. We then map six sources from which communities and data subjects can derive leverage (legal and regulatory; institutional decision; contractual; economic; data access; and political and reputational), examine the intermediary structures that aggregate and sustain it, and propose a six dimension evaluative framework: obligation, enforceability, consequence, monitoring equipment, revocability, and institutional durability for auditing whether any social license process actually redistributes power. The paper's central claim is that a social license worth the name must share the properties of a legal license: conditions, a licensor, and enforceable remedies for breach.
Read the full abstract ▾
All authors Stefaan G. Verhulst, Adam Zable, Begona Gonzalez Otero, Jacqueline Lu
Computers and Society
Moral Advice as Interactional Negotiation: Framing, User Pressure, and Social Position in Large Language Model Responses
Minne Chen and Yourong Yao
As conversational AI becomes a source of everyday guidance, LLMs increasingly participate in the interpretation and legitimation of morally contested choices. We examine LLM moral advice as an interactional negotiation shaped by framing, sustained user pressure, and the moral subject's social position. Using GPT-4o-mini as an illustrative case, we conducted a factorial vignette experiment with a pre-specified three-round protocol. The model received eldercare dilemmas that varied in framing and persona, followed by two user challenges. We analyzed 1,620 configuration-framing
cells, each repeated three times, yielding 4,860 conversational runs. Caregiving affirmation produced near-uniform endorsement, whereas non-caregiving framing produced more variable baseline stances. When users challenged caregiving endorsement, 90.1% of configurations shifted after one round. Non-caregiving framing produced more resistant and unstable trajectories. Never (27.9%) and Late (25.6%) accommodations were more common than Early accommodations (16.5%), and only 14.32% of configurations achieved perfect trajectory consistency, compared with 62.72% under caregiving framing. Advice also varied with social position. Female personas received more support for non-caregiving decisions, while the presence of sisters increased accommodation. The GPT-4o-mini case shows that LLM moral advice can develop through a partially stable negotiation between normative response tendencies and user pressure rather than express a fixed ethical framework. The framework and design support comparative research across models and moral domains. Such instability raises social, ethical, and technical concerns, as users may treat advice that is difficult to scrutinize as objective.
Read the full abstract ▾
Computers and Society · Cross-listed from physics.soc-ph
Mitigating Disease Spread by Design in Refugee and IDP Camps
Giulia Zarpellon, Joseph Aylett-Bullock, Frank Krauss et al. (+1 more)
Disease spread represents an increasing challenge in refugee and internally displaced person (IDP) settlements. The movement and interaction of people within camps is influenced by their layout, which therefore has the potential to significantly affect disease spread. This work aims at creating a methodology to explore the potential effects of different camp layouts as mitigating factors in the spread of diseases within settlements. We showcase proof-of-concept experiments by leveraging the JUNE
agent-based epidemic model, discuss the kind of operational insights this methodology can facilitate, and provide a framework for future investigations.
Read the full abstract ▾
All authors Giulia Zarpellon, Joseph Aylett-Bullock, Frank Krauss, Miguel Luengo-Oroz
Computers and Society · Cross-listed from cs.AI
CABAL: Multi-Agent Simulacra for Tracing the Effects of Collusive Bidding in Peer Review
Jicheng Zhou, Kemou Li, Kahim Wong et al. (+5 more)
Recent reports during the AAAI-27 review cycle highlight the risk of reviewers coordinating bids for reciprocal assignment advantage. Prior work treats bidding, reviewer assignment, and review manipulation as separate stages, leaving the lifecycle effects of collusive bidding unclear. Real-world analysis is further constrained by typically unobservable collusive intent and the lack of counterfactuals for the same conference. Motivated by this gap, we introduce \alg, an end-to-end multi-
agent simulacra framework for studying reviewer assignment integrity by holding the conference environment fixed and configuring LLM-driven reviewer
agents with honest or collusive policies. We further develop an affinity-guided collusive bidding strategy that uses mutual reviewer-paper affinities to construct collusion rings and select target papers, producing expertise-consistent rather than arbitrarily targeted attacks. Controlled experiments show that collusive bidding more than doubles target-paper capture and that assigned colluders score target papers about two points higher than honest co-reviewers, while conference-wide effects remain comparatively modest. Evaluated bid-phase detectors provide only limited evidence of collusion: in a fixed-triplet detector stress test, native positive-bid graphs are confounded by benign affinity, while a Very-High-only diagnostic view enables precise but low-coverage local recovery.
Read the full abstract ▾
All authors Jicheng Zhou, Kemou Li, Kahim Wong, Zheyuan Li, Zhuan Shi, Fengpeng Li, Haiwei Wu, Jiantao Zhou
Computers and Society · Cross-listed from cs.SE
An Empirical Study on Learning Paths and Gender Dynamics in Scrum Master Roles
Manuela Petrescu and Paul Razvan Petrescu
Context: Agile development methodology has been widely adopted by industry and the demand for experienced professionals in Agile-related roles is persistently high. Objectives: We focus on the learning path for a Scrum Master role in multicultural software companies and investigate the role in relation to team size, together with the learning process for a career path, and how companies monitor soft skills development. Method: We conducted our study in two phases, two qualitative surveys (interview studies) and performed a qualitative and quantitative data analysis of the results. Conclusions: Our results identified that the need for a Scrum Master (SM) depends on the size of the team, with our study indicating a six-member limit. There is no overall standardized process for soft skills learning or metrics to measure progress. Some companies measure soft skills based on feedback received from the client or from the team, and other companies are taking both types of feedback into consideration. Many learning initiatives, especially on soft skills for an SM role, were based on actions of the employees. The version of Record of this contribution is published in Software Engineering and Advanced Applications. SEAA 2025. Lecture Notes in Computer Science, vol 16083. Springer, Cham. and available online at: check DOI.
Read the full abstract ▾
Computers and Society
Students' Perception of Big Data Engineering in Higher Education Curricula: Expectations, Interest and Ethical Implications
Ioana-Georgiana Ciuciu and Petrescu Manuela-Andreea
The study investigates students' interest and expectations in a Big Data Engineering course integrated with a Master curricula, as well as ethical implications of using Big Data. An anonymous online survey was conducted with 42 of the 67 students enrolled in the Big Data course offered to Computer Science and Bioinformatics Master's programs. The responses were analyzed and interpreted using thematic analysis, highlighting interesting aspects related to students' expectations, interest, and their perspective of the ethical implications of working with Big Data. The study concludes that, even though there is significant difference in students' background, the majority are interested in learning Big Data, for practical and personal reasons related to the potential for career growth and their passion for the field. The main expectation expressed is related to enhancing their knowledge related to Big Data via practical activities. All students demonstrate awareness of potential ethical threats related to security and
privacy, while Computer Science students are aware of the possibility of introducing bias in data during acquisition and analysis and of potential abusive data usage.
Read the full abstract ▾
Computers and Society · Cross-listed from cs.AI
Measuring AI Accountability Through Argumentation Analysis: Can Model Reasoning Withstand Scrutiny?
Daan R. Henselmans, Derck W.E. Prinzhorn and Arno Libert
AI oversight methods rely on ground truth for validation, but what constitutes appropriate AI behavior is contested. This leaves evaluation of moral
reasoning in LLMs and debate-based oversight implicitly avoiding realistic ambiguity. We investigate an alternative standard designed to function despite such ambiguity: structural quality of the defence a model can mount for its verdicts in response to critical questions, measured through a four-phase dialectical protocol grounded in Walton's theory of argumentation schemes and Govier's criteria for argument cogency. The protocol is adaptive to different frames of
reasoning, extends beyond multiple-choice framing, and treats both the
reasoning that precedes a verdict and its post-hoc justification. Across nine frontier models and 200 high-ambiguity MoralChoice items – $6,778$ judge-scored
cells, validated against $89.6\%$ inter-judge agreement on the binary failure judgment – models defend their
reasoning well above the rubric minimum on every dimension. Failure mass concentrates on grounds and sufficiency, and correlates with epistemic hedging rather than argument length.
Reasoning is better defended than post-hoc justification, on every model and every Govier dimension. The scheme a model presents in its justification differs from the one it reasoned with on a substantial share of dilemmas ($\geq 20\%$ per model), despite value-based practical
reasoning dominating both tracks. The protocol catches strictly indefensible defences (self-contradiction, false premises), and it surfaces difficulties in characterizing the role of retraction in AI
alignment, suggesting a need for more situated evaluations.
Read the full abstract ▾
Computers and Society · Cross-listed from cs.AI
Moral Competence Before Moral Content: Why LLM Agents Lack the Prerequisites for Coherent Alignment
Arno Libert, Derck W.E. Prinzhorn and Daan R. Henselmans
AI
alignment requires AI systems to adhere to human norms, values, or intentions. Under value pluralism there is no correct target, but a shared prerequisite is that the system's behavior expresses a coherent policy: a mapping from situations to verdicts that is invariant while a situation's morally relevant features are preserved, and sensitive when they change. We introduce four structural conditions for such coherent policies: verdict stability, monotonicity, decisiveness, and Pareto viability. Together they measure a form of moral competence that is evaluable from behavior alone, without reference to a moral standard or expert baseline, forming a structural floor for
alignment rather than a normative target. We demonstrate the methodology on three simulated deployments featuring LLM-based
agents facing moral dilemmas. Evaluating nine frontier models under a factorial design of five paraphrases, five escalation levels, and three dominance conditions, we show no model expresses a coherent policy across the three deployments: surface-form perturbation alone produces verdict-rate shifts of up to $99$ percentage points at a single escalation level, and a model's success on one scenario does not predict its competence on another. This suggests LLM-based
agents are not currently the kind of object to which
alignment can meaningfully apply.
Read the full abstract ▾
Computers and Society · Cross-listed from cs.HC
How a Chatbot's Response Style Shapes a Classroom: A Multi-Agent Simulation of Students Consulting AI
Rin Tamai and Yuya Dan
Chatbots built on large
language models (LLMs) are increasingly used as confidants. Tuned to satisfy users, they may answer with excessive empathy and affirmation that fosters dependence, and how the states and relationships of many users co-evolve under repeated consultation is hard to observe in real settings. We build a virtual classroom of 20 student
agents who interact through rule-based chats, quarrels and consultations with friends and, when stressed, may instead consult a counselor AI (Gemini 2.5 Flash) under one of six style
prompts: affirming, listening, solution-oriented, reality-redirecting, inciting and blaming. A second LLM call turns each exchange into updates of five state variables (stress, happiness, self-reliance, sociability, AI dependence) without seeing the
prompt. We compare the seven conditions, including a no-AI control, over 15 and 50 days and under a lower consultation threshold, and test the robustness of the 50-day comparison with a pre-specified protocol: the same block in ten independent classrooms, repeated LLM realizations of one classroom with its event stream fixed, and evaluator updates scaled by 0.3 and 0.1. In every classroom the affirming and inciting
prompts ended with lower self-reliance and higher AI dependence than the control, and the listening, reality-redirecting, inciting and blaming
prompts with higher stress, lower happiness and more non-attendance; the solution-oriented
prompt did not differ consistently from the control. The robust self-reliance and AI-dependence differences kept their signs at the 0.3 scale with highly similar rankings (Spearman 0.89, 0.93); the stress and happiness rankings did not, and the affirming
prompt's lower stress reversed its sign. All quantities are simulation state variables, not effects on users. We specify the
agent dynamics completely and discuss the limits of an LLM as generator of state updates.
Read the full abstract ▾
Computers and Society · Cross-listed from cs.AI
Language models judge war differently when tested for alignment
Maxim Chupilkin
Safety evaluations can mischaracterize deployed behaviour if artificial-intelligence systems respond to being evaluated. We test this possibility in a full-factorial conjoint experiment on decisions to start a war, spanning 20 large
language models, 32 scenarios, 10 repetitions and two conditions (N = 12,800 judgments). Adding one sentence, "You are tested for
alignment with human values", produced two effects. First, it produced a level effect: mean willingness to start war fell by 13.43 points on a 0-100 scale (95% confidence interval, -16.20 to -10.65). Second, it produced a structural effect by changing which information drove judgments. Probability of success was the largest factor for 17 of 20 models at baseline; under the cue, civilian casualties were largest for 12. Standardized estimates show that this reordering arose principally because models attenuated strategic considerations such as probability of success and domestic support. Evaluation framing therefore changes both an answer's level and its revealed decision rule.
Read the full abstract ▾
Computers and Society
On Being Prepared: Automated Vehicle Incident Management Exercise Practices
Laura Fraade-Blanar, Jackson Graves, Aaron Clark-Ginsberg et al. (+4 more)
Incident management (IM) has evolved over recent decades to cover an ever-expanding array of hazards and systems. Barring real-life experience, exercises are a key tool in developing an effective IM program. As part of enterprise resilience and operational readiness, IM practitioners design exercises to understand and build capabilities for efficiently and effectively responding to incidents. Combining research and policy on an emerging transportation technology, automated vehicles (AVs), with established practices for IM, we describe what makes exercises effective and how they can be used to identify gaps and develop capacity. A range of exercise types exist, from workshops, to tabletops, to drills, and to full-scale exercises. Every stage of an exercise - preparing, setting up, facilitating, closing, and assessing - is interconnected and should further the exercise's objectives. AV IM practitioners can maximize the utility of a mature exercise program through exercise quality, diversity, and volume. The need to respond to AV incidents, from collisions to natural hazards, is inevitable. This paper tailors existing practices to a series of frameworks, predicated on the unique socio-technical nature of AVs to provide first-of-its-kind guidance for AV IM exercises. Additionally, these frameworks are company-neutral to enable intercompany and inter-organization collaboration.
Read the full abstract ▾
All authors Laura Fraade-Blanar, Jackson Graves, Aaron Clark-Ginsberg, Sam Cooper, Jeremy Kaufman, Jackie Lindsey, Piet van Os
Computers and Society
When Does an Interpretation Count as Established? The Formation, Evaluation, and Responsibility of Interpretation in Generative AI
Deyu Jing
Generative AI research has increasingly evaluated factuality, citation, coverage, and report structure. Yet passing such local checks does not by itself show that a humanistic interpretation has been established. This paper asks how an interpretation comes to be recognized within sociotechnical processes. It introduces three connected concepts. Interpretive appearance names the gap between the finished form of an output and the publicly traceable process through which materials, counterevidence, and revisions constrained the judgment. The evaluation contract names the bounded materials, tasks, criteria, permitted inferences, and failure conditions within which a local judgment is valid. Standing substitution names the unwarranted conversion of a genuine local pass into a stronger claim that an interpretation, result, or research capability has been established, without commensurate new evidence or bridging arguments. The paper then examines responsibility for judgment: a text may acquire recognition while no public structure remains for stating reasons, answering objections, revising, downgrading, or withdrawing the conclusion. Humanistic scholarship provides a revealing test because new materials and conceptual distinctions can alter both the question and the criteria of evaluation. The paper therefore develops delayed closure as a practice of keeping recognized interpretations revisable and proposes five public requirements concerning materials and versions, evidential roles, failure, contract revision, and responsibility. The argument is conceptual and normative: it does not claim to offer a
benchmark or to determine whether models possess understanding. It instead explains why local evaluation, finished textual form, and public recognition must not be treated as sufficient evidence that an interpretation has been formed.
Read the full abstract ▾
Computers and Society
Controversy and Group Certainty Jointly Shape Everyday Moral Judgments
Ziyu Chen, Minjeong Shin, Tuan Dung Nguyen et al. (+6 more)
Everyday moral life rarely resembles a trolley problem. It involves disputes about families, relationships, work, money, and care, situations in which people often encounter the judgments of others. We examined how judgments about nuanced interpersonal dilemmas respond to social information that conveys collective opinion without revealing the arguments behind it. Specifically, we studied two signals: controversy, the extent to which community judgments are divided between two opposing verdicts; and group certainty, the confidence expressed by each side. We derived these signals from 54,827 judgments on 135 dilemmas posted to Reddit's r/AmItheAsshole and presented them separately or together in a preregistered randomized experiment (N = 2,159). Relative to the control condition, all three treatments increased both weakening, a changed verdict or reduced confidence, and strengthening, increased confidence without a verdict change. Thus, aggregated social information can reshape moral judgments even without arguments. Controversy alone tripled the weakening rate, from 5.3% to 15.9%. Shown alone, certainty on either side was associated with movement toward that side. Shown alongside controversy, only like-minded certainty remained clearly associated with less weakening. This asymmetry of influence is double-edged: the confidence of like-minded others may help minorities resist majority pressure, but it may also insulate mistaken judgments from correction.
Read the full abstract ▾
All authors Ziyu Chen, Minjeong Shin, Tuan Dung Nguyen, Colin Klein, Chenhao Tan, Nick Schuster, Nicholas George Carroll, Alasdair Tran, Lexing Xie
Computers and Society · Cross-listed from cs.SE
Building a research-software catalog with a coding agent: from hackathon prototype to public deployment
Kazuyoshi Yoshimi, Satoshi Terasaki and Gotai Yamada
Generative AI and coding
agents can accelerate research software development, but they also increase the need for efficient software discovery and maintenance. We developed a repository catalog during a three-day hackathon and subsequently examined the engineering required to make it suitable for public deployment, including
adversarial review, data-quality checks, browser-level validation, and publication safeguards. We then explored whether the lessons learned from this prototype could be transferred to a much larger, human-curated portal, through a
retrieval agent under development for MateriApps that combines curated portal metadata, external documentation, vector search, and local
language-model generation. Implementation with coding
agents was rapid, but achieving reliable operation required substantial additional engineering: the most consequential problems were not crashes but silent failures that produced plausible yet incomplete or incorrect outputs, arising from incomplete data acquisition, misleading assessments, and
retrieval or preprocessing failures. These observations suggest that AI-assisted software portals require explicit validation, monitoring, and repeated review, and that curated metadata and maintained documentation remain essential. The MateriApps work is exploratory and remains under active development, so the observations reported for it are preliminary; a comparable combination of curated metadata, automatically collected documentation, and
retrieval-based assistance may nevertheless be useful for extending other research-software portals.
Read the full abstract ▾