Computers and Society
Silicon sampling answers with country-level assumptions, not individual attitudes: Cross-national evidence from the European Social Survey
Chuyao Wang
Silicon sampling uses large
language models (LLMs) to simulate survey respondents. Whether it recovers cross-national variation, and why, remains unresolved. This study evaluates it against European Social Survey Round 11 (30 countries, 42 items) with two open-weight LLMs under first- and third-person
prompts, plus backstory and response-format experiments. Aggregate recovery is moderate and uneven across items. Adding the country name to a three-variable demographic backstory raises the median per-item correlation between simulated and observed country means from -0.03 to 0.52, and the richer profiles tested add no consistent gain. The respondent's country label acts as a country-level assumption that respondent detail does not revise. Naming the response-scale endpoints in words stops the model from ranking countries backwards, so the answer format sets the direction of the ranking. Individual-level recovery remains negligible in every condition and does not track aggregate recovery across countries. An average of neighboring countries, using no LLM, recovers country levels more accurately than every model condition and ranks them about as well. Silicon sampling can thus support exploratory country-ranking comparison after item-level validation and with the response format reported. It does not support individual or distributional inference.
Read the full abstract ▾
Computers and Society
Do job seekers value procedure in AI hiring only for error correction? Evidence from a conjoint experiment
Chuyao Wang, Patrick Sturgis and Daniel de Kadt
Employers increasingly delegate initial screening to automated systems, which in many cases reject an application before any human reads it. Acceptance of such systems plausibly depends both on how well they perform and on the procedure that produces the decision. Prior studies rarely vary procedure and performance independently, leaving it unclear whether applicants value procedure for its own sake or for the errors it corrects. In a preregistered paired-profile conjoint experiment, 1,919 United States job seekers made eight choices between systems with independently randomized levels of decision authority, error rate, explanation, opt-out, appeal, and independent bias audit. The value of the appeal, the opt-out, and the bias audit did not rise as wrongful rejections became more common, each staying within a preregistered equivalence bound. Human involvement carried more weight than any procedural feature, moving stated choice about as much as cutting wrongful rejections from 30% to 10%. These patterns constrain a simple error-correction account and are consistent with applicants valuing procedure partly for its own sake, so that improving a system's performance does not substitute for a right applicants can invoke.
Read the full abstract ▾
Computers and Society · Cross-listed from cs.CL
How Humans and LLMs Read Gender into "Gender-Neutral" Physical Descriptions
Yingjia Wan, Lin Lin and Elisa Kreiss
When foundation models describe people, recent work in AI
fairness, accessibility, and ethics recommends avoiding inferred identity labels (e.g., "she", "his") in favor of seemingly "objective" physical descriptions (e.g., "short hair", "a defined jawline"). Yet whether such descriptive
language achieves gender-neutral communication remains an open empirical question. To study this, we introduce GAPA (Gender Associations of Physical Attributes), a
dataset of 316 common physical attributes drawn from diverse sources, paired with 14,706 gender-association ratings from 304 US-based annotators. Results show that physical descriptions carry structured and graded gender associations among readers, with more consistent and distinctive associations for women and men than for non-binary identities. Next, we evaluate 16 LLMs across model families, sizes, and post-training variants against human ratings. The models partially recover human associations but exhibit systematic
alignment biases, including compressed rating distributions, weaker
alignment for associations with men, and asymmetric abstention that disproportionately targets the non-binary category. Finally, we release the best-performing proxy model trained to predict humans' gender associations of descriptive
language and demonstrate its utility through a sociolinguistic analysis of character descriptions in LitBank. Together, our findings provide the first empirical evidence that seemingly "objective" physical descriptions can retain systematic gender associations in human interpretation, and uncover systematic patterns of model-human misalignment. This challenges the assumption that replacing explicit gender labels with physical descriptions necessarily yields gender-neutral communication, and highlights downstream challenges in using such descriptions to communicate subjective identity categories in human-AI interaction.
Read the full abstract ▾
Computers and Society
Mapping U.S. Federal AI Governance Against Sector Vulnerability
Ho Ting Hung, Angelica Chowdhury, James Teague et al. (+5 more)
Artificial intelligence (AI) poses different levels of risk across sectors, but are these differences reflected in U.S. federal AI governance? To help answer this question, we assess 684 federal AI governance documents for their coverage of 14 sectors and 24 AI risks. We measure coverage as breadth (i.e., how frequently the risk or sector is addressed across documents) and depth (i.e., how substantively the risk or sector is discussed). We then compare sector coverage patterns for each of the 24 risks with vulnerability assessments from a Delphi study of 272 experts. Our analysis finds substantial variation in coverage: AI risks related to robustness, system security, and governance receive more
attention than socioeconomic, environmental, and emerging risks, including multi-
agent risks. Public administration, national security, information, and scientific services receive comparatively high levels of coverage relative to other sectors, such as finance and healthcare, which experts rate as highly vulnerable to AI risks. By mapping current coverage and identifying where it differs from expert assessments of vulnerability, we surface potential AI governance gaps which may help inform AI risk-related decisions across government and industry.
Read the full abstract ▾
All authors Ho Ting Hung, Angelica Chowdhury, James Teague, Simon Mylius, Spencer Michaels, Peter Slattery, Alexander Saeri, Neil Thompson
Computers and Society
AI-Driven Feedback Systems, Digital Labour, and Silent Quitting: Transforming African Workplaces
Abayomi O. Agbeyangi and Jose M. Lukose
The current trend of digitalisation has revolutionised the organisation of work and the way it is measured and performed across the globe, with AI becoming more common for managing labour and performance, as well as employee communication. In African organisations, where there is increasing adoption of remote work, hybrid models of work, digital collaboration, and data-based HR management, the notion of silent quitting has become more relevant, defined as worker disengagement when employees are still doing their job but do not put any effort into achieving good performance and exhibiting any emotion. This paper investigates how AI-driven feedback mechanisms, including sentiment analysis systems, pulse surveys, chatbots, engagement dashboards, and predictive analytics, are changing African workplaces through offering continuous listening, instant performance information and proactive engagement with employees. The study also explores how AI can assist organisations in identifying early disengagement and enable intervention and better employee communication in both private and public sector organisations in Africa. At the same time, we address the challenges of socioeconomic development and governance posed by AI implementation in developing countries, including digital inequality, infrastructure shortcomings,
privacy concerns, algorithmic bias, and the risk of workplace surveillance. By situating silent quitting within wider debates on digital labour and automation, the paper contributes an African-centred perspective to discussions on the future of work and offers practical recommendations for HR professionals, managers, policymakers, and technology developers seeking responsible, context-sensitive approaches to workplace transformation across the continent.
Read the full abstract ▾
Computers and Society · Cross-listed from cs.AI
GPEvac: GNN-Based PPO for Adaptive Evacuation Routing During Shooting Events
Daniel Perkins and Subhadeep Chakraborty
The sharp increase in mass shootings underscores an urgent need for systems that guide victims to safety in real time. An effective evacuation system must minimize threat exposure while also accounting for
adversarial uncertainty and crowding dynamics. Current methods in the literature are rigidly constrained to layout-specific policies and computationally intractable in large-scale layouts, while practical guidelines simply advise victims to "run", "hide", or "fight". We propose GPEvac: a GNN-based PPO framework that computes adaptive evacuation routes during shooting events. To capture both local and long-distance dependencies, we introduce an edge-first sequential message-passing scheme with a learnable virtual global node. The resulting graph
embeddings are integrated into a permutation-invariant scoring mechanism that allows a single learned policy to operate across building layouts of diverse
topologies and sizes. Through extensive simulation, we show that GPEvac outperforms intelligent baselines across distinct architectural layouts, significantly reducing total threat exposure. Crucially, the system computes global evacuation routes in just 14.73 ms on local CPU hardware, enabling seamless integration with live surveillance systems. In addition to saving lives during shooting events, the methodologies developed are transferable to other graph-structured decision-making domains, including critical infrastructure, intelligent transportation systems, and adaptive sensor networks.
Read the full abstract ▾
Computers and Society · Cross-listed from cs.SI
netseg: a Python Package for Measuring Structural Polarization and Segregation in Social Networks
Onur Tuncay Bal and Michał Bojanowski
The study of structural polarization and segregation in social networks is an established line of research, and the quantification of both phenomena proceeds through a set of widely cited network indices. The code implementing those indices, however, is seldom released and almost never tested. We present netseg, a comprehensively documented Python package implementing these indices, most of them generalized to more than two groups and to directed as well as undirected input. It ports the R package of the same name and adds measures the R version lacks, among them Random Walk Controversy, Boundary Connectivity, Dipole Moment, and Moran's I. The package operates on igraph objects and performs the underlying graph operations (e.g., neighborhood queries and random-walk simulation) through igraph's Python interface, so that they execute in compiled code rather than in interpreted Python. For several of the indices this yields runtimes orders of magnitude below those of the available open-source implementations, which the documentation reports in
benchmarks. Most of these indices are defined as a divergence from a null model, and published implementations fix that null model to a uniform random graph of matching density. netseg accepts an ensemble of graphs as a sample from an arbitrary null model, and distinguishes indices that already incorporate a baseline from those that do not, adjusting the comparison accordingly to avoid double subtraction. The documentation provides, for each index, a worked empirical example, its behaviour at the degenerate cases where it is undefined, a
benchmark, and the procedure for substituting a custom null model. We report the behaviour of every index over a parameter sweep of a generative opinion model, and apply them to a county-level railroad network built from nineteenth-century operator records joined to full-count census data.
Read the full abstract ▾
Computers and Society · Cross-listed from physics.soc-ph
How to build a campfire? Participatory modelling with justice
Nynke van Uffelen, Sander ten Caat, Aarthi Sundaram et al. (+4 more)
Energy transition decision-making is pervaded by deep uncertainties. Computational models are helpful in addressing such uncertainties, as they can give insight into techno-economic complexity. However, models alone are insufficient, as part of the uncertainties involve justice dilemmas.
Read the full abstract ▾
All authors Nynke van Uffelen, Sander ten Caat, Aarthi Sundaram, Annemiek de Looze, Marion Collewet, Eefje Cuppen, Igor Nikolic
Computers and Society · Cross-listed from cs.HC
The CAST-framework: Measure and model social media use as a multi-level phenomenon through real-world applications
David Grüning, Jasper Doeninghaus, Zina Efchary et al. (+8 more)
Designing social media experiences that support well-being requires understanding when, how, and for whom use matters. Screen-time totals omit content and context, and connecting these with behavior and experience requires coordinating measurements across timescales. We introduce the CAST framework to connect measurement choices with person-specific models of exposure, behavior, physiology, and experience. Its dimensions specify where observations occur, how they are obtained, what they measure, and at what temporal resolution. Responses to interventions, such as whether to proceed after an app-opening pause, enter as behavioral measurements. We propose four synchronized measurement modules linking mobile and wearable data with self-reports and intervention responses. A synthetic demonstration with 120 simulated participants over 28 days illustrates how daily aggregation can obscure opposing effects of different activities under specified generating assumptions. The framework guides selection of measures and outcomes for evaluating social media interfaces and interventions.
Read the full abstract ▾
All authors David Grüning, Jasper Doeninghaus, Zina Efchary, Yui Kondo, Kevin Dunnell, Lennart Fischer, Isabella Zimmermann, Linnea Körte, Leo Mehlig, Frederik Riedel, Paul Schmiedmayer
Computers and Society · Cross-listed from cs.HC
How do people plan digitally: An in-the-wild investigation of task planning through a smartphone app
Srija Halder, Isabella Zimmermann, Linnea Körte et al. (+3 more)
Daily planning supports goal attainment and productivity, and people increasingly delegate it to digital tools. Plans are postponed, revised, and left unresolved rather than executed as intended. Understanding these changes requires following tasks from creation through later updates and recorded outcomes. We report an in-the-wild study of task planning using time-stamped logs of 24,265 tasks from 957 users of a widely used daily planner app, observed over six weeks alongside self-reported surveys. Following each task across its lifecycle, only 26.4% moved directly from creation to completion and 32.0% were abandoned; all-day and longer tasks were abandoned disproportionately, and 77.6% of timed tasks were marked complete later than intended. Latent profile analysis of 909 users indicated High Engagement (11.1%), Low Engagement (19.7%), and Passive (69.2%) profiles; active days on app distinguished the profiles and were associated with post-survey completion. These findings support evaluating planning tools across the task lifecycle.
Read the full abstract ▾
All authors Srija Halder, Isabella Zimmermann, Linnea Körte, Leo Mehlig, Paul Schmiedmayer, David Grüning
Computers and Society · Cross-listed from cs.CL
Before You Poll with LLMs: A Deliberative Diagnostic Framework
Ahmed Wali and Hassaan Tayyab
Can LLMs reason through new information like humans, or do they merely retrieve cached opinions? This is critical for silicon sampling, where LLM personas simulate public opinion at scale. Current evaluations test only whether personas hold the right opinions – a static snapshot. But opinion research increasingly depends on dynamic fidelity: whether personas update beliefs in response to new arguments, as humans do during deliberation. No existing
benchmark tests this. We introduce the Deliberative Polling Diagnostic Framework, which compares human and LLM belief shifts after identical informational interventions. Grounded in deliberative polling, it surfaces failures invisible to static evaluation: models that produce plausible partisan opinions can still misrepresent how those opinions change. Applying the framework to five frontier models using data from America in One Room (526 personas, 72 questions), we find that every model fails, each in a unique manner. GPT-5.1 exhibits reversal: its personas become more hostile toward the opposing party after balanced information, while humans become less so. This reversal is selective (80% on outgroup vs. 26% on policy questions) and symmetric across partisan identities. Gemini 2.0 Flash, Claude Sonnet 4.5, and Llama 3.3 70B exhibit overshoot, shifting correctly but at 5-7x human magnitude. DeepSeek V3 exhibits rigidity with near-zero change. Targeted ablations reveal that policy content triggers these failures and that they are identity-specific: GPT-5.1 reverses on outgroup questions but overshoots on ingroup; Gemini shows the inverse. We term this signature self-sycophancy: conformity to the model's internal stereotype of the persona rather than
reasoning from the information provided. Our framework offers a concrete protocol: run the deliberative diagnostic before trusting LLM personas to mimic revised beliefs.
Read the full abstract ▾
Computers and Society · Cross-listed from cs.AI
Are LLMs Good Financial User Simulators? Multi-view Investor Logic Alignment (MILA)
Jiajie He, Jiangyuan Hong, Xintong Chen et al. (+2 more)
Large
language models (LLMs) are increasingly used as user simulators, yet it remains unclear whether their predictions faithfully reproduce the evolving decisions of individual users. We investigate this question in a controlled longitudinal paper-trading study with 80 participants, where user interactions, simulated transactions, virtual portfolio states, and point-in-time
market information are aligned under a rolling next-day prediction protocol. We evaluate behavioral fidelity hierarchically, from trade occurrence to action structure, asset selection, and downstream portfolio consequences. Across 1,239 aligned user-days, no evaluated LLM reliably outperforms a simple recent-activity persistence baseline for predicting whether a user trades. Fidelity further deteriorates at finer levels: models struggle to recover buy–sell structure and traded assets, and similar activity-level predictions can lead to substantially different portfolio trajectories. Controlled evidence ablations show that recent trading history strongly governs activity prediction, whereas asset selection is substantially more sensitive to the available evidence. An observational analysis further finds that intensified ticker-specific research predicts imminent trading, but diagnostic tests do not support a causal interpretation. These findings suggest that current LLMs capture useful short-term behavioral regularities without yet recovering a stable individual decision mechanism.
Read the full abstract ▾
All authors Jiajie He, Jiangyuan Hong, Xintong Chen, Dongling Ni, Wenjin Liu
Computers and Society · Cross-listed from cs.HC
When AI Companions Disappear: Relational Continuity and Collective Contestation during China's National AI Regulatory Transition
Yunhao Yuan, Kejia Zhang, Yuqi Niu et al. (+3 more)
AI model updates and service withdrawals can disrupt relationships with AI companions, but research has largely examined individual platform events. Less is known about users' responses when multiple providers implement shared national regulations. We examine users' reactions and collective contestation surrounding China's 2026 regulation of anthropomorphic AI interaction services. We collected RedNote discussions from April 10 to August 10, 2026, used a validated
language model for relevance screening, and conducted qualitative content and thematic analyses of 89 posts, 1,425 comments, and 2,005 replies. Users retained, migrated, and reconstructed companions, finding that preserving conversation records did not necessarily restore shared
memories or familiar interactions. They compared regulations, platform explanations, and implementations to assign responsibility. Solidarity emerged through mutual aid and appeals to respect other communities' attachments, while disputes over targets and tactics exposed contested terms of collective action. Infrastructural dependence connected relational continuity and collective contestation during this national regulatory transition.
Read the full abstract ▾
All authors Yunhao Yuan, Kejia Zhang, Yuqi Niu, Yajing Wang, Renwen Zhang, Talayeh Aledavood
Computers and Society · Cross-listed from cs.HC
Time Machine Experiments: Using Historically-Bounded AI for Inquiry into the Human Mind
Hiromu Yakura, Robin Schimmelpfennig, Ezequiel Lopez-Lopez et al. (+5 more)
Can interacting with someone from 1930, with no knowledge of what happened after, influence a person's perception of the past? People reason about the present against a picture of the past without observing it. The past is reconstructed from
memory and testimony, but this reconstruction has been filtered through everything that happened since. Historically-bounded large
language models (LLMs) make that past available for interaction. As a proof-of-concept for the impact of interacting with historical minds, we ran a preregistered randomized experiment ($N=240$), where participants interacted with an LLM trained on pre-1930 text. The interaction reduced the illusion of moral decline, the tendency to view the past as more moral than the present, compared to the contemporary-model control. This Time Machine Experiment paradigm informs new forms of interactive experiments, where temporal knowledge boundaries become experimental variables, and expands the realm of science fiction science, which turns thought experiments into actual experiments.
Read the full abstract ▾
All authors Hiromu Yakura, Robin Schimmelpfennig, Ezequiel Lopez-Lopez, Alejandro H. Artiles, Levin Brinkmann, Jean-François Bonnefon, Azim Shariff, Iyad Rahwan
Computers and Society · Cross-listed from cs.SE
The Future of Safety for SaMD
Rhea Malhotra, Tanya Sharma, Krisha Patel et al. (+7 more)
An artificial organ carries failure consequences on the scale of an aircraft or a reactor, but the software driving it is rarely held to the same standard. Teams building them rely on testing, which only reaches the failure modes someone thought of in advance. In a pump or controller that runs inside a patient for months, the dangerous cases are the ones nobody anticipated. Formal verification closes that gap. Applied to the device's software, it proves the code meets its specification for every execution that specification allows, and where a proof fails, it returns the exact input sequence that breaks it. The same methods already protect rail, aviation, and nuclear control systems, and they extend the IEC 62304 lifecycle that a manufacturer already follows rather than replacing it. In this paper, we explore how to apply formal verification to artificial organs, stage by stage, and what each technique actually guarantees about the device.
Read the full abstract ▾
All authors Rhea Malhotra, Tanya Sharma, Krisha Patel, Satvika Sharma, Heena Purkait, Mehak Nehal Makhija, Aellison Cassimiro, Everett Hildenbrandt, Palina Tolmach, Jaidev Shastri
Computers and Society · Cross-listed from cs.AI
Can AI systems have free will?
Christian List
While there has been much discussion of whether AI systems could function as moral
agents or acquire sentience, there has been very little discussion of whether AI systems could have free will. I sketch a framework for thinking about this question, inspired by Daniel Dennett's work. I argue that, to determine whether an AI system has free will, we should not look for some mysterious property, expect its underlying
algorithms to be indeterministic, or ask whether the system is unpredictable. Rather, we should simply ask whether we have good explanatory reasons to view the system as an intentional
agent, with the capacity for choice between alternative possibilities and control over the resulting actions. If the answer is "yes", then the system counts as having free will in a pragmatic and diagnostically useful sense.
Read the full abstract ▾
Computers and Society · Cross-listed from cs.SE
When Digitalization Transforms Itself: AI, Software, and the Next Technical Order
Ina K. Schieferdecker
Agentic artificial intelligence (AI) marks a new phase of digitalization: digitalization is beginning to act back upon its own technical production base. Whereas earlier phases aimed at digitizing analog information, automating processes, and building digital value networks, AI is increasingly taking over tasks in the development of digital systems themselves. In software engineering (SE) in particular, agentic AI systems can already plan, execute, check, and iteratively refine development tasks across multiple steps. Digitalization thus becomes recursive: digital systems no longer merely support the digitalization of other sectors, but are increasingly developed and evolved by digital systems themselves. The technical production base of digitalization thereby becomes the object of its own transformation. This changes not only the division of labor between humans and machines in SE, but also the role of SE as a whole. This chapter analyzes this socio-technical change and argues that SE is evolving from a primarily supporting engineering discipline into a central infrastructure of societal value creation as well as of technological and digital sovereignty.
Read the full abstract ▾
Computers and Society · Cross-listed from cs.AI
Issue Bias in Generative AI Writing Assistance: Political Issues and LLMs in the Swedish 2026 Election
Bastiaan Bruinsma, Annika Fredén, Paul Röttger et al. (+2 more)
Generative AI writing assistants and the Large
Language Models (LLMs) that power them are increasingly part of how voters gather information before elections. With growing evidence that they influence users' opinions, it is increasingly important to understand the views and positions of these tools. To better understand these views, we examine the stances supplied by six LLMs on a variety of Swedish-
language writing tasks ahead of the 2026 Swedish parliamentary election. We cross 107 policy propositions with 77 writing templates and neutral, positive, and negative
prompt framings, producing 24,717
prompts per model and 148,302 responses. To study these, we look at the models' default stance tendencies, compare how they respond to similar issues, and compare their responses with those of each of Sweden's eight parliamentary parties on the same issue. We find that Claude, DeepSeek, Gemini, and Mistral have similar profiles; ChatGPT more often supplies neutral or ambivalent text; and Grok differs most on topics such as migration, crime, and gender. When comparing the political parties, we find that the Social Democrats are closest to all six models. Still, after correcting for multiple comparisons, none of the within-model differences in party distances remains significant. Overall, we find that no model has a clear preference, nor a clear preference for a party, but that this depends on the specific issue or task the user asks about.
Read the full abstract ▾
All authors Bastiaan Bruinsma, Annika Fredén, Paul Röttger, Moa Johansson, Asad Sayeed
Computers and Society · Cross-listed from cs.HC
Personalizing Personal Health Interfaces: Co-Design with Generative AI
Karthik S. Bhat, Vidhi Shah, Vedika Agnihotri et al. (+2 more)
Personal health interfaces present wellbeing data through standardized dashboards that rarely fit how people interpret or act on it. Personalizing them to what people would like to see for themselves often requires design and technical expertise, a barrier that generative AI may potentially lower. Therefore, we ask what designs emerge and how it enables and constrains the design process. We conducted a co-design study where 14 participants redesigned Google and Apple Health interfaces using Figma Make. Participants reimagined interfaces that supported personal context, future planning, and interactive experiences, yet conversational AI designs converged around chat-window conventions. AI helped materialize loosely articulated ideas, but model defaults and generation latency shaped iteration. The process more readily operationalized interpretability and accountability than
privacy, trust, and emotional safety. Generative co-design let participants create interfaces directly, blurring the boundary between intentions and model defaults. We discuss implications for preserving agency and flexible user-directed interfaces.
Read the full abstract ▾
All authors Karthik S. Bhat, Vidhi Shah, Vedika Agnihotri, Dong Whi Yoo, Koustuv Saha
Computers and Society · Cross-listed from cs.HC
PeerPen: AI-Assisted Writing for Online Mental Health Peer Support
Jiwon Kim, Sherry Gong, Maya Ajit et al. (+5 more)
Online mental health communities thrive on peer support, yet those who volunteer to help often lack formal training and may struggle to articulate supportive responses. AI co-writing could lower this barrier; however, peer support derives much of its value from being perceived as personal, raising questions around authorship, ownership, and trust. We built PeerPen, a writing assistance tool embedded within a Reddit-like interface, supporting two main features: draft generation and revision of user-written responses. Through semi-structured interviews with 15 participants, we find that PeerPen reduced the burden of composing responses and increased confidence in offering support. Participants wanted AI to assist their writing without taking over authorship and anticipated tensions around authenticity and trust. Such assistance could make authorship uncertain even for responses written without it, weakening trust across the community. We contribute design implications for AI writing assistance that scaffolds supportive communication, preserves authorship, and accounts for community-level trust.
Read the full abstract ▾
All authors Jiwon Kim, Sherry Gong, Maya Ajit, Soorya Ram Shimgekar, Yunhao Yuan, Dong Whi Yoo, Eshwar Chandrasekharan, Koustuv Saha
Computers and Society · Cross-listed from cs.SE
Toward Sustainable AI Deployment: A Carbon-Aware Decision Framework for Enterprise Supply Chain Systems
Haoran Yu, Lifei Liu and Danping Zhang
Enterprises deploying AI for supply chain decisions commonly default to the largest available
language model, a procurement heuristic that neglects both empirical performance and environmental cost. We
benchmark six large
language models across 520 supply chain tasks, simultaneously measuring decision quality and estimated generation-related operational carbon. Drawing on the Technology-Organization-Environment (TOE) framework, we develop a Carbon-Aware AI Procurement Framework (CAAPF), a Green IS design artifact that operationalizes sustainable AI governance for enterprise procurement. Within this bounded sample, quality spans 0.497-0.723, and the models with the largest disclosed parameter totals do not achieve the highest scores. The design does not isolate size, provider, architecture, or
benchmark-construction effects. A category-by-tier calibrated GreenRoute proof of concept reaches 0.733 mean out-of-sample quality at an estimated 0.402 gCO2/task. Static Haiku reaches 0.699 at 0.022 gCO2/task, while Sonnet reaches 0.723 at 0.401 gCO2/task, demonstrating that the preferred strategy depends on the organization's quality requirement. Our "
benchmark first, select green" principle suggests that environmental responsibility and decision quality can be mutually reinforcing, contributing to sustainable digital infrastructure governance aligned with SDG 12 and SDG 13.
Read the full abstract ▾