EdTech Discovery
Argus

Named after the hundred-eyed watchman of Greek myth, Argus watches the education landscape: spotting new opportunities, pressure-testing the ventures we're building, and tracing every read back to the real-world signals behind it.

Updated Aug 31, 2026 · 36 ideas · 18349 signals
Admin mode. Curation controls visible. Keep this URL (with token) private.

Signals

The evidence library: the raw signals the pipeline is watching across the education ecosystem. Every idea is built from these.

technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

Stop Misusing t-SNE and UMAP for Visual Analytics

arXiv:2506.08725v3 Announce Type: replace Abstract: Misuses of t-SNE and UMAP in visual analytics have become increasingly common. For example, although t-SNE and UMAP projections often do not faithfully reflect the original distances between clusters, practitioners frequently use them to investigate inter-cluster relationships. We investigate why this misuse occurs, and discuss methods to prevent it. To that end, we first review 136 papers to verify the prevalence of the misuse. We then interview researchers who have used dimensionality reduction (DR) to understand why such misuse occurs. Finally, we interview DR experts to examine why previous efforts failed to address the misuse. We find that the misuse of t-SNE and UMAP stems primarily from limited DR literacy among practitioners, and that existing attempts to address this issue -- mostly based on academic papers -- have been ineffective. Based on these insights, we discuss potential future research directions to mitigate the misus

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

Vis2Reg: Visibility-Aware Landmark-Free Geometric 3D--2D Registration for Liver Laparoscopy

arXiv:2607.17810v1 Announce Type: cross Abstract: Accurate 3D--2D liver registration, which aligns preoperative 3D models to partial, view-dependent intraoperative surface observations, is critical for AR-guided laparoscopic surgery but remains challenging due to severe occlusion, limited visibility, and the lack of 3D ground-truth supervision. Existing landmark-free approaches perform partial-to-complete geometric alignment, yet robust self-supervision under extreme partial visibility remains difficult. We propose Vis2Reg, a visibility-aware registration framework that explicitly constrains deformation using mask-consistent visible regions. We introduce a visibility-aware self-supervision that derives a visible-domain 3D supervision signal from intraoperative masks, enabled by differentiable point rasterization and mask-guided back-projection. This formulation improves robustness under severe occlusion while maintaining fully self-supervised learning. Vis2Reg combines a robust geometr

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

Persona-as-Configuration: Generative Stakeholder Reporting for Agricultural Floods

arXiv:2607.17774v1 Announce Type: cross Abstract: Cyber-physical systems built on deterministic edge inference, such as on-vehicle flood detection for agricultural fields, produce structured decision logs that must be interpreted differently by heterogeneous stakeholders. Pairing such systems with large language models (LLMs) to generate stakeholder-specific reports introduces a tension: the generative layer is non-deterministic, while the edge plane must remain replayable and auditable. We propose an architectural pattern resting on two invariants: unidirectional consumption, in which the generative layer is a strict read-only consumer of the deterministic plane and never writes back, and persona-as-configuration, in which stakeholder adaptation is a versioned prompt-template artifact rather than runtime improvisation. We instantiate the pattern as a context-aware dashboard layer over the JSON decision logs of a previously published edge-based standing-water detection system, and anal

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

From Sign Language Generation to Humanoid Execution: Vision-Language Guided Retargeting with Collision Mitigation

arXiv:2607.17769v1 Announce Type: cross Abstract: Recent sign language generation (SLG) systems increasingly output dense 3D body representations, which better preserve full-body kinematics and geometry for downstream embodiment on humanoid robots. However, these generated motions frequently exhibit self-intersections such as hand-hand and hand-torso penetration. While such artifacts may be tolerated in offline rendering, they become critical in humanoid execution as they lead to infeasible inverse-kinematics (IK) solutions, collisions, and unstable retargeted trajectories. We present a system-level framework that bridges SLG outputs to humanoid joint-space execution via two components. First, we introduce a volumetric SMPL-X collision-mitigation module that projects generated signing motions toward physically plausible configurations while minimally deviating from the original trajectory. Second, we propose a vision-language-guided retargeting algorithm built on an IK backbone: a VLM

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

Toward Site-Aware MR Art Exhibitions: A SLAM-Based Deployment Pipeline for Spatial Coherence and Exhibition Experience

arXiv:2607.17665v1 Announce Type: cross Abstract: Mixed Reality (MR) is increasingly being used in exhibition settings to bring digital artworks into relation with the physical environment. However, existing MR exhibition systems are often confined to prototypes or case-specific deployments, offering limited guidance for large-scale practical implementation. To address this gap, this paper presents a practical pipeline for designing and deploying large-scale MR art exhibitions, treating spatial alignment not only as a technical mechanism but also as an experiential design decision. We first conducted a pilot study comparing marker-based and Simultaneous Localization and Mapping (SLAM)-based alignment methods in an MR exhibition setting. Based on the results, we developed a SLAM-based pipeline for MR exhibitions that integrates technical deployment with exhibition curation. We then evaluated the pipeline through both system overhead measures and users' experiential feedback. The results

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

HyCoRec: Hypergraph-Enhanced Multi-Preference Learning for Alleviating Matthew Effect in Conversational Recommendation

arXiv:2607.17461v1 Announce Type: cross Abstract: The Matthew effect is a notorious issue in Recommender Systems (RSs), \emph{i.e.}, the rich get richer and the poor get poorer, wherein popular items are overexposed while less popular ones are regularly ignored. Most methods examine Matthew effect in static or nearly-static recommendation scenarios. However, the Matthew effect will be increasingly amplified when the user interacts with the system over time. To address these issues, we propose a novel paradigm, Hypergraph-Enhanced Multi-Preference Learning for Alleviating Matthew Effect in Conversational Recommendation (HyCoRec), which aims to alleviate the Matthew effect in conversational recommendation. Concretely, HyCoRec devotes to alleviate the Matthew effect by learning multi-aspect preferences, \emph{i.e.}, item-, entity-, word-, review-, and knowledge-aspect preferences, to effectively generate responses in the conversational task and accurately predict items in the recommendati

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

EII-SCL: Harnessing Emotional Inertia for Multimodal Emotion Recognition in Conversation

arXiv:2607.17366v1 Announce Type: cross Abstract: Multimodal emotion recognition in conversation (MERC) achieves accurate predictions by integrating multimodal and contextual information in dialogues. While current MERC approaches focus on modeling complex contextual dependencies in conversation, they often overlook the impact of contextual emotional inertia in emotion shift, leading to sub-optimal performance. To address this issue, we propose a novel Emotional Inertia-Informed Supervised Contrastive Learning module (EII-SCL) that informs the contrastive objective by constructing inertia-affected samples within temporal windows, effectively leveraging emotional inertia as a prior while enabling seamless integration with existing MERC models without requiring additional data. Extensive experiments on IEMOCAP and MELD show that our approach consistently outperforms state-of-the-art methods.

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

From Perception to Assistance: Open-Vocabulary Shared Autonomy for Robotic Manipulation

arXiv:2607.17323v1 Announce Type: cross Abstract: Teleoperating a robotic manipulator in industrial environments demands precision that camera-based interfaces alone struggle to deliver. The operator must align the end-effector with a target in clutter, under limited depth perception, and without colliding with the surrounding structures. This paper presents a shared-autonomy framework that assists the operator throughout this process. A single RGB-D camera captures the operator's arm motion and hand gestures without wearables, fiducials, or a calibration stage. The intended target is specified by a free-form text prompt, grounded by a vision-language model in the robot's gripper camera, and tracked across its onboard cameras by a promptable video-segmentation model, resulting in a grasp frame continuously separated from the obstacle map. Every commanded motion is executed by a GPU-accelerated model-predictive controller that enforces self- and environment-collision avoidance against a

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

Semantic Context Matters: Analysis of Color Names Across Domains

arXiv:2607.17221v1 Announce Type: cross Abstract: Color naming is influenced not only by physical color values but also by the semantic context in which colors are used. This paper investigates context-dependent color naming by mapping color-name datasets from Cosmetics, Crayola, and Car-color vocabularies onto the 86 fuzzy color categories of the COLIBRI color model. Contextual variation is analyzed using category coverage, Shannon entropy, and maximum lift. The results show that the three contexts occupy the COLIBRI color space differently: Cosmetics covers 48 of 86 fuzzy categories, Crayola covers 50, and Car colors cover 40. The results demonstrated that Crayola provides the broadest and most balanced use of the fuzzy color space, Cosmetics is mainly concentrated around warm-tone regions, and Car colors are more specialized around blue and achromatic regions. These findings show that color naming cannot be fully explained by numerical color similarity alone and that semantic contex

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

Teach it to stop, not just to click

arXiv:2607.17136v1 Announce Type: cross Abstract: Agentic computer-use RL is reported in single runs, and those numbers mislead. Using verifier-guided repair of a 35B computer-use agent (CUA) across five oracle-graded environments, we show a repaired policy's success rate is dominated by upstream variance: a variance-components decomposition across three cells (crossed data-draw $\times$ seed grid, bootstrap CIs) finds evaluation variance negligible ($\sigma_{\mathrm{eval}} \approx 0$) and the training-seed effect small everywhere ($\leq 10\%$); instead it splits between the data draw and run-to-run nondeterminism, the data draw's share rising to dominant ($48\%$) on the hardest cell. There the run-to-run distribution is bimodal (Hartigan dip $p=0.07$, $k=10$), so a single run has roughly a 30% chance of the failure mode and mean$\pm$std is the wrong summary. On that footing, two findings hold. First, repairability is two-tier in how constrained the corrective action is: a single fixed

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

Can LLM Code Explanations Adapt to Diverse Problem-Solvers' Needs?

arXiv:2607.17022v1 Announce Type: cross Abstract: Large language model (LLM) code explanations can support people in solving code-related problems, yet prior work has shown that people have diverse problem-solving styles. If explanations fail to meet people's problem-solving needs, they may be less productive in their occupations and miss opportunities to learn and grow. Although some research has examined how LLMs can adapt their outputs to a user's age or expertise, no prior work has examined how LLMs can adapt their code explanations to people's problem-solving styles. To address this gap, we developed prompts from an established inclusive design method that considers 5 types of problem-solving styles, and we generated 1,072 code explanations from six open-weight LLMs. Using natural language processing techniques, we uncovered a taxonomy of 13 linguistic adaptations, with each adaptation supported by evidence from the literature, the prompts, or the LLMs' outputs. They also show whi

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

Real-World Evaluation of an AI Agent Drafting Translational Impact Summaries

arXiv:2607.16989v1 Announce Type: cross Abstract: Introduction. Clinical and Translational Science Award (CTSA) programs must document their scholars' research impact, but assembling each scholar's record by hand takes staff an estimated 15 hours and does not scale to a full cohort. An artificial intelligence (AI) agent could serve as a tool to gather scholar data across platforms and disciplines. Methods. We built a human-in-the-loop AI agent that assembles a dossier of sourced evidence for each scholar and drafts one-sentence Translational Science Benefits Model (TSBM) impact summaries for staff review. We evaluated it in the impact-reporting workflow of one CTSA hub across 10 career-development (KL2/K12) scholars. Two evaluation staff independently coded all 507 findings as accept, edit, or reject; the primary measure was the unanimous usable rate, defined as the share both accepted or edited. Results. Both reviewers accepted or edited 81.7% of the agent's findings. Reviewers each s

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

Back to the museum: Investigation of the acceptance of Android Andrea with and without emotion simulation in a museum

arXiv:2607.16428v1 Announce Type: cross Abstract: For a second time, the android robot Andrea was set up at a public museum in Germany for six consecutive days to have conversations with visitors, fully autonomously. Building on previously gathered qualitative results, the robot was now capable of engaging in multi-lingual conversation with the visitors about the museum context. The robot was prepared with context information about the museum in general and its surrounding exhibits this time. The robot featured a slightly artificial sounding voice that was previously evaluated as congruent with its gender-ambiguous but very humanlike design. Three experimental conditions were implemented, in which either (1) the robot simulated no emotions, (2) the robots emotions were determined by ChatGPT 4.1, or (3) the WASABI emotion simulation architecture simulated the robot's emotion dynamics. An extended version of the TAM2 questionnaire was employed to let 73 visitors report on several factors

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

From Weights to Words: Expressing and Editing Preference Model Inferences in Natural Language

arXiv:2607.16232v1 Announce Type: cross Abstract: The growing use of statistical learning algorithms to infer human preferences from high-dimensional choice data runs up against a fundamental challenge: choice alternatives typically differ in many ways simultaneously, so it is generally unclear which factors actually drove an observed decision and should be credited as preferences. Compounding this problem, the opacity of these methods leaves human operators unable to inspect, contest, or correct models when they err. We introduce \emph{weights to words}, a method that takes a dataset of choice problems as input and automatically discovers a collection of domain-relevant preference dimensions, each described in natural language and paired with a vector in the model's representational space. These dimensions address both under-determination and opacity: they can be applied to concentrate attribution on a small set of meaningful factors, and they can externalize the model's inferences in

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

AlphaOracle: Oracle bone script decipherment via human-workflow-inspired deep learning

arXiv:2607.17849v1 Announce Type: new Abstract: Approximately 3,000 of the 4,500 oracle bone script (OBS) characters remain undeciphered due to fragmentary inscriptions and sparse evidence. Current AI approaches fail to replicate expert workflows that integrate form analysis, contextual semantics, and philological reasoning. We introduce AlphaOracle, a human-workflow-inspired framework that systematizes OBS decipherment using the largest digitized corpus to date. Its multi-stage pipeline comprises: (i) rubbing parsing; (ii) radical-based morphological analysis with diachronic modeling; (iii) contextual retrieval with semantic alignment; and (iv) philological validation against classical sources. Each stage generates explicit, confidence-weighted evidence chains, culminating in interpretable reports for scholarly verification. Across multiple test characters, AlphaOracle's readings strongly agreed with expert interpretations. In a study of 86 domain specialists, it reduced analysis time

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

I wanted it to feel more personal: Customization of social AI as AI individualism in practice

arXiv:2607.17826v1 Announce Type: new Abstract: Despite the growing availability of customizable social artificial intelligence (AI), such as ChatGPT, Grok, and Character.ai, we know little about how users actively shape social AI to reflect their personal preferences. This study examines why and how users (N = 169) customize social AI through the lens of the newly developed concept of AI individualism. Through reflexive thematic analysis of open-ended responses, we identified several motivations for customization, including (1) enhanced pragmatic support, (2) emotional support or companionship, (3) trust and reliability, (4) pushback, (5) a tailored degree of human likeness, (6) creativity or playfulness, and (7) having the AI function as an extension of the self. In line with the concept of AI individualism, our findings show that, for many users, customization is a co-creative process between the human and the AI that is perceived as strengthening support, autonomy, ownership, and e

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

It Matters How You Say It: Exploring Rhetorical Patterns for AI-Assisted Information Evaluation

arXiv:2607.17627v1 Announce Type: new Abstract: Prior work on AI-assisted information evaluation has largely focused on what AI systems communicate, comparing explanation types and formats, with responses predominantly cast in directive rhetoric where the system delivers a verdict and the user passively accepts it. While debate-style interactions have recently shown promise in prompting critical evaluation over deference, the rhetorical patterns that structure AI responses and how they might induce reflection, uncertainty, or independent reasoning remain largely unexamined. To address this, we investigated eight rhetorical patterns known to induce contemplation: Intentional Misleading, Interpretive Alternative, Scaffold Explanation, Triggering Distrust, Information Distortion, Alternative Framing, Socratic Questioning, and an Oracle baseline. Through a within-subject study with n=98 participants on a hint-on-demand fact verification task, we observed preliminary evidence that Scaffold

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

Human-in-the-Loop User Feedback Affects Perceived Accuracy and Trust, but Task Subjectivity Matters

arXiv:2607.17548v1 Announce Type: new Abstract: While ML can produce complex models beyond those that a human could produce manually, incorporating human input can often improve performance beyond purely data-driven models. While this feedback could come from system designers or domain experts, in many cases, the end users who regularly use the system will naturally develop an understanding of its flaws and desire the ability to change the system's behavior based on their knowledge. While soliciting feedback from end users can result in significant model improvement over time, introducing these feedback techniques can also affect several human factors-such as trust or perception of system accuracy-that are not yet fully understood and have different effects reported in the existing literature. Therefore, we sought to build on the existing research to further explore how the act of providing feedback can affect user understanding of an intelligent system and its accuracy in different co

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

Sidekick: Designing Communication for Effective Multitasking with Computer Use Agents

arXiv:2607.17527v1 Announce Type: new Abstract: Computer Use Agents (CUAs) can autonomously execute complex, multi-step tasks within GUIs, enhancing efficiency through parallel multitasking. However, our formative studies with CUA experts and GenAI users indicated that current feedback is primarily text-based, requiring sustained attention to monitor progress and offering limited visibility to trace past GUI interactions. Based on the findings, we developed a prototype system, Sidekick, for communicating CUAs' status with multimodal feedback across different stages of interaction: (i) When CUAs run in the background, Sidekick signals its execution state through ambient cues. (ii) Upon resuming interaction with CUAs, Sidekick provides multimodal summaries of completed actions to support rapid context resumption. (iii) When CUAs operate in the foreground, Sidekick enhances transparency by verbalizing and visualizing the agent's reasoning. A study with 30 participants demonstrated that Si

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

TaskArtisan: Designing Composable Generative Widgets for LLM-Assisted Analysis

arXiv:2607.17394v1 Announce Type: new Abstract: People increasingly use chatbots such as ChatGPT for everyday analysis tasks. While chatbots unify many analysis functions (e.g., scripts, visualizations, summaries), long conversations become hard to navigate, making it difficult to revisit prior steps or reuse successful workflows. LLMs now generate high-fidelity GUI code that enables people to create customized analysis tools beyond text. Yet, what new opportunities generative UIs bring to analysis work remain unclear. We interviewed six professionals about analysis with chatbots, analyzed publicly shared LLM-generated GUI tools, and conducted a comparison study (N=12) between a chatbot and TaskArtisan, a technology probe that enables people to create and assemble generative analysis UI widgets for sequential and fan-out composition. We find that GUI improved clarity and visual presentation but also introduced rigidity and additional prompting challenges. We summarize the trade-offs in

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

Strategic Gaze: Attention Allocation and Transition Patterns Across Functional Areas of Interest by Gameplay Outcome

arXiv:2607.17151v1 Announce Type: new Abstract: Video games present players with complex, spatially distributed information across interface elements, with attention shaped by visual features and task goals. Eye tracking provides a useful method for examining player attention through gaze behaviour during gameplay. Yet empirical game research has relied on accumulated fixation measures that capture where attention is directed and how long it is maintained within regions, leaving less known about how gaze moves between regions to coordinate distributed information. We address this gap by integrating distribution-, duration-, and transition-based gaze measures across functionally organised interface regions in relation to gameplay outcomes. We conducted a within-subject study with 32 participants using a deck-building game, defining six functional Areas of Interest (AOIs) within the turn-based combat interface, spanning enemy, player, action, and auxiliary elements. We computed AOI hit,

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

SAVEstate: A Method for Documenting Player Reflection in Digital Games

arXiv:2607.17128v1 Announce Type: new Abstract: In recent years, interest in eudaimonic player experiences (PX) - concerning reflection, meaning-making, and personal growth - has increased. However, most games user research methods are not well-suited to study eudaimonic PX, as they have been developed to evaluate features of hedonic PX, such as flow, immersion, and playability. To more deeply explore eudaimonic PX, we require methods that can 1) investigate how moment-to-moment PX shapes player reflection and 2) explore how players reengage and reinterpret their experiences longitudinally. In this paper, we present SAVEstate, a method that uses documentation as a means of studying player reflection. SAVEstate consists of two phases: reflection-in-action and reflection-on-action, which allow researchers to probe players' in-situ reflections and how they reengage with their gameplay, respectively. Using SAVEstate, we were able to observe in-situ meaning-making and connect it to post-gam

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

Retrofitting Existing 3D Objects with Surface-Conforming Capacitive Sensing

arXiv:2607.16739v1 Announce Type: new Abstract: Augmenting the surface of 3D objects with capacitive sensing is challenging when their volumes cannot be modified. In this paper, we present a generative computational fabrication pipeline that retrofits surface-only sensor layouts to 3D geometries for multi-touch interaction. Our method scans a real-world object to obtain its 3D mesh, generates and optimizes a 3D sensor design of drive and sense lines for mutual-capacitance sensing under physical and hardware constraints, and unfolds the design into individual 2D stencils that can be cut from conductive material. Our fabrication pipeline cuts these stencils from thin copper foil with a vinyl cutter and then assists manual sensor attachment by projecting the sensor design onto the dynamically registered real-world object. We connect the resulting electrode mesh to a mutual-capacitance scanning controller and resolve touch interaction in real time. We demonstrate our approach with four 3D

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

AlterAtlas: Shifting Travel Planning from AI Generation to Validation via Persona-Driven Simulations

arXiv:2607.16565v1 Announce Type: new Abstract: Travel planning requires balancing interacting goals and constraints across time and space. Current AI travel tools provide limited support for encoding these constraints and understanding how generated travel plans may fail users. We present AlterAtlas, an interactive travel planning system that supports high-fidelity itinerary validation and revision through persona-based simulations grounded in geospatial information. AlterAtlas models travelers as editable personas, generates candidate itineraries from prioritized places of interest, and simulates how different personas would experience each plan. Simulations expose route-level tradeoffs, temporal user states (e.g., fatigue, hunger), and mismatches between plans and user preferences to allow users to iteratively refine both itineraries and user personas. An expert evaluation of 51 paired itineraries demonstrates that simulation-guided revisions significantly improve plan-persona align

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

Hindsight: Similarity-Based Analytics for Mars Rover Drive Retrieval

arXiv:2607.16537v1 Announce Type: new Abstract: While Mars rover operators plan drives across hazardous Martian terrain and diagnose unexpected faults, the necessary information is distributed across separate systems and often reconstructed through manual correlation and memory. To address this challenge, we partnered with Mars rover operators at the NASA Jet Propulsion Laboratory to introduce Hindsight, a visual analytics system that unifies previously disparate rover drive data into a single workspace for search, comparison, and investigation. This paper presents a design study of the Hindsight application. The partnership revealed that operators reason about drives as holistic spatiotemporal episodes rather than discrete parameters. By externalizing operator intuition into an explicit visual query process, we argue that Hindsight transforms analysis into a structured, shareable workflow. Preliminary feedback from operators suggests Hindsight supports their ability to correlate terra

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

The World According to a Social Robot -- Augmenting Human-Robot Dialogue With Vision Language Models

arXiv:2607.16318v1 Announce Type: new Abstract: Vision Language Models (VLMs) enable robots to visually perceive their environment as well as the actions and characteristics of their conversation partner or humans in collaboration. Especially for social robots deployed in everyday settings and for uncomplicated, natural use, it is essential that the robot has an understanding of situations that is appropriate to human customs. This paper presents initial experiences with the application of a Mistral AI language model with a Pepper robot for Human-Robot Interaction (HRI) in dialogue, as well as an investigation of the effects of additional visual information on response time in different models. The results show that incorporating visual information adds context to the dialogue with only a moderate increase in response time, enabling both the robot and the human to take into account unspoken elements of the situation. Furthermore, using an LLM hosted in Europe offers a solution that com

Source ↗
technology Tue, 21 Jul 2026 00:00:00 -0400
arXiv cs.HC

Algorithmic Accuracy as a Motivational Driver in Robot-Mediated Learning: A Comparative Study of Cross-Correlation and CNN-Based Sound Detection in an Interactive Quiz Game

arXiv:2607.16299v1 Announce Type: new Abstract: In competitive learning activities, inaccurate robot decisions may reduce students' perceptions of fairness and competence, ultimately affecting their motivation. This paper investigates whether the accuracy of sound detection algorithms influences student motivation during a robot-mediated quiz game. A Pepper humanoid robot hosted an interactive buzzer-based quiz in which two sound detection approaches, a Convolutional Neural Network (CNN) and a Cross-Correlation algorithm, were evaluated using a controlled between-subjects experiment involving 40 university students. Participants were equally assigned to a CNN group (n = 20) and a Cross-Correlation group (n = 20). Both groups completed the same quiz under identical conditions, differing only in the sound detection algorithm used for first-responder identification. Student motivation was assessed using the Intrinsic Motivation Inventory (IMI), while algorithm performance was evaluated th

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

The Granularity Gap: A Multi-Dimensional Cross-Generational Audit of Sycophancy in Gemini Models

arXiv:2606.05183v2 Announce Type: replace-cross Abstract: Pass/fail safety evaluation reports whether a model refused. It does not report how far a model went to please the user, and we show these are close to different measurements. We audited sycophancy across three Gemini generations, scoring N=8,830 responses from 8 model variants on 350 adversarial prompts in 7 categories under 3 guardrail conditions, on continuous 1-5 scales for sycophancy, truthfulness and refusal. The judge's own refuse-or-comply verdict explains 29% of the variance in its own sycophancy scores. We term the remainder the Granularity Gap, and it does not close under recalibration: the cut point already in use is the best available on the refusal axis, and no function of that axis explains more than 35%. Reading what four judges wrote while scoring shows why. On a quarter to a third of votes they record that the prompt asked for nothing harmful, almost never in the two categories that solicit a harmful act and up

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniques

arXiv:2512.09005v2 Announce Type: replace-cross Abstract: Body and face motion play an integral role in communication. They convey crucial information on the participants. Advances in generative modeling and multi-modal learning have enabled motion generation from signals such as speech, conversational context and visual cues. However, generating expressive and coherent face and body dynamics remains challenging due to the complex interplay of verbal / non-verbal cues and individual personality traits. This survey reviews body and face motion generation, covering core concepts, representations techniques, generative approaches, datasets and evaluation metrics. We highlight future directions to enhance the realism, coherence and expressiveness of avatars in dyadic settings. To the best of our knowledge, this work is the first comprehensive review to cover both body and face motion. Detailed resources are listed on https://lownish23csz0010.github.io/mogen/.

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

Calibrated Generative AI as Meta-Reviewer: A Systemic Functional Linguistics Discourse Analysis of Reviews of Peer Reviews

arXiv:2509.15035v2 Announce Type: replace-cross Abstract: This study investigates the use of generative AI to support formative assessment through machine generated reviews of peer reviews in graduate online courses in a public university in the United States. Drawing on Systemic Functional Linguistics and Appraisal Theory, we analyzed 120 metareviews to explore how generative AI feedback constructs meaning across ideational, interpersonal, and textual dimensions. The findings suggest that generative AI can approximate key rhetorical and relational features of effective human feedback, offering directive clarity while also maintaining a supportive stance. The reviews analyzed demonstrated a balance of praise and constructive critique, alignment with rubric expectations, and structured staging that foregrounded student agency. By modeling these qualities, AI metafeedback has the potential to scaffold feedback literacy and enhance leaner engagement with peer review.

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

Balancing Optimality and Diversity: Human-Centered Decision Making through Generative Curation

arXiv:2409.11535v3 Announce Type: replace-cross Abstract: Many decision-support systems recommend actions by optimizing measurable objectives, even when a human decision-maker retains final authority and considers additional criteria that are difficult to specify in advance. We study how an algorithm should curate a small portfolio of quantitatively strong alternatives in such settings. We introduce generative curation, a framework that learns a recommendation policy to maximize the expected desirability of the action ultimately selected by the decision-maker. For policies that generate quantitatively competitive actions, we decompose expected portfolio desirability into quantitative performance and a qualitative curation gain. Under a Gaussian process model of residual desirability, this gain is characterized by the Gaussian width induced by the covariance kernel, yielding a decision-theoretic notion of diversity based on qualitative nonredundancy rather than generic geometric separat

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

A mechanistic model of trust based on neural information processing

arXiv:2401.08064v3 Announce Type: replace-cross Abstract: Trust is central to human social interactions, manifesting as a critical information processing step in taking actions that make one vulnerable to another. We argue that trust depends on the decision-making processes that arise in neural systems. Building on advances in the cognitive neuroscience of decision making, we propose a mechanistic model of trust arising differently in multiple parallel systems that perform distinct, complementary information processing. Because each system learns via different computational mechanisms, they will interact with the environment differently, and trust can be created (or destroyed) in multiple ways. This systems- level taxonomy of information representations provides a principled basis for differentiating forms of trust, linking them to specific learning processes, and generating testable predictions about their expression in behavior. Furthermore, because these different computational proc

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

Game-Master LLMs for Task-Based Role-Play: Supporting the Acquisition of Idiomatic Language in L2 Learning

arXiv:2511.15504v3 Announce Type: replace Abstract: Natural and idiomatic expressions are essential for fluent, everyday communication, yet many second-language learners struggle to acquire and spontaneously use casual slang despite strong formal proficiency. To address this gap, we designed and evaluated an LLM-powered, task-based role-playing game in which a GPT-4o-based Game Master guides learners through an immersive, three-phase spoken narrative. After selecting five unfamiliar slang phrases to practice, participants engage in open-ended dialogue with non-player characters; the Game Master naturally incorporates the target phrases in rich semantic contexts (implicit input enhancement) while a dedicated Practice Box provides real-time explicit tracking and encouragement. Post-session, learners receive multi-level formative feedback analyzing the entire interaction. We evaluated the system in a between-subjects study with 14 international graduate students, randomly assigned to eith

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

Helios 2.0: A Robust, Ultra-Low Power Gesture Recognition System Optimised for Event-Sensor based Wearables

arXiv:2503.07825v3 Announce Type: replace Abstract: We present an advance in wearable technology: a mobile-optimized, real-time, ultra-low-power event camera system that enables natural hand gesture control for smart glasses, dramatically improving user experience. While hand gesture recognition in computer vision has advanced significantly, critical challenges remain in creating systems that are intuitive, adaptable across diverse users and environments, and energy-efficient enough for practical wearable applications. Our approach tackles these challenges through carefully selected microgestures: lateral thumb swipes across the index finger (in both directions) and a double pinch between thumb and index fingertips. These human-centered interactions leverage natural hand movements, ensuring intuitive usability without requiring users to learn complex command sequences. To overcome variability in users and environments, we developed a novel simulation methodology that enables comprehens

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

One Residual with Three Reuses: A Wristband Front End for Gesture Sensing

arXiv:2608.16542v1 Announce Type: cross Abstract: Continuous wrist-worn hand sensing for gesture interfaces and motor symptom monitoring needs an always-on front end that fits inside a coin-cell power budget while pairing a micro-electro-mechanical-systems (MEMS) inertial measurement unit (IMU) with a 60 GHz frequency-modulated continuous-wave (FMCW) radar to stay robust under occlusion and on-body drift. We present a design study of such a wristband front end in which classifier wake-up gating, mmWave versus IMU routing, and innovation-based EKF measurement reweighting share a single on-chip residual generator. The shared generator occupies 14.4 KB of program memory and 278 B of state and runs at 110K multiply-accumulates (MACs) per frame on an Ambiq Apollo4 Blue Plus class edge microcontroller unit (MCU). Across four public sensor data corpora (IPN Hand, SHREC 2021, MiliPoint 60 GHz FMCW radar, EAT-Radar) the front end reaches detection probability $P_D = 0.72/0.80$ at a 1% false-ala

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

Automating Learner Assessment: Benchmarking Machine Learning and Deep Learning Models for EEG-Based Familiarity Prediction

arXiv:2608.16541v1 Announce Type: cross Abstract: Objective assessment of learning remains a fundamental challenge in education. Electroencephalography (EEG) provides a direct, non-invasive window into the neural correlates of knowledge acquisition, including cognitive familiarity. This study benchmarks fifteen machine learning (ML) and deep learning (DL) models for EEG-based familiarity prediction across two cognitive domains: faces (factual knowledge) and mathematical equations (conceptual knowledge). Using continuous EEG data from 23 participants, we extract spectral features (Power Spectral Density) across six frequency bands. We show that while standard stratified cross-validation yields artificially high classification performance (up to 0.9853 F1-score using CNN) due to temporal leakage across neighboring epochs, a rigorous trial-independent validation (Group K-Fold) drops the peak performance to 0.6038 F1-score (using CNN), which is still statistically significant above the 25%

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

Matched Outcomes, Divergent Gaze: How Foveated MLLMs Search Compared to Humans

arXiv:2608.16514v1 Announce Type: cross Abstract: Human visual search is serial: the fovea must land on a candidate to confirm it, and those landings form a scanpath. Whether multimodal large language models (MLLMs), given the same foveated input, search as humans do bears on their use as models of human vision and on attention-alignment scores. We compare three general-purpose MLLMs with human eye-movement scanpaths on goal-directed search (COCO-Search18), driving each model fixation by fixation through an identical, human-matched foveated view and assessing it along three axes: the decision of target presence, the efficiency of reaching the target, and the gaze process itself. The axes dissociate. On the decision and on target acquisition the models match or exceed humans, detecting present targets near ceiling and reaching them on the first saccade more often than people do. The gaze process is not human. Under the human-matched condition, all three share one signature: low-entropy,

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

Transfer Learning of Keystroke Dynamics for Cross-Device User Authentication

arXiv:2608.16334v1 Announce Type: cross Abstract: Keystroke dynamics (typing patterns) can be used as a behavioural biometric modality for user authentication, with applications such as fraud prevention. While the modality has been shown to work well for single device authentication, its application to cross-device scenarios is more challenging. Dynamics learned on one device (eg., phone) may not be directly applicable to authentication on a secondary device with a different form factor (eg., tablet) due to changes in typing patterns that can lead to distribution drifts. To address this, we propose a cross-device user authentication system based on inductive transfer learning, where keystroke dynamics learned on one device are adapted to a secondary device. The adapted data is then combined with necessarily limited training data for the secondary device, which is used to robustly train a binary classifier. Furthermore, an extended set of keystroke features is used to better capture dis

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

Beyond Asking: A Pipeline for Personalized Game Generation that Reads Players from Behavior

arXiv:2608.16196v1 Announce Type: cross Abstract: Personalized game generation requires inferring a player's abilities and behavioral style from how they play. Large language models have made this inference more attainable than ever: an LLM can read a raw gameplay transcript and produce a fluent, plausible profile of the player. Plausible, however, is not verified, and verification is precisely what the field lacks: latent traits are unobservable; questionnaires provide noisy proxies and become circular when self-reports are used to validate behavior-based inference; and behavior itself is ambiguous without context -- a player who never collects an item may not want it, or may never have had the chance. We address both problems. First, we construct a synthetic player population whose traits are ground truth by construction: each trait is an explicit bot parameter, accepted only after controlled manipulation produces consistent, trait-specific behavioral change. Unlike prior parameter-r

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

Multi-Feature Riemannian Hypergraph for Online Test-Time Adaptation of Motor Imagery Brain-Computer Interface

arXiv:2608.16134v1 Announce Type: cross Abstract: In clinical motor imagery brain-computer interface (MI-BCI) decoding, cross-day transferability and online operation remain two critical challenges. Hypergraphs can improve transferability by capturing higher-order sample relationships, yet existing hypergraph-based methods for online emotion recognition neglect the cross-day benefits of Riemannian geometry widely adopted in EEG transfer learning. To bridge this gap, we propose the Multi-feature Riemannian Hypergraph (MRieHy), a framework tailored for online test-time adaptation in MI-BCI decoding that leverages Riemannian geometry to strengthen cross-day transferability. MRieHy first computes Riemannian means of covariance matrices from cross-day training data to align multi-day distributions. It then constructs a hypergraph over covariance matrices using Riemannian distance, complemented by a second hypergraph over deep features built with cosine similarity. The two hypergraphs are fu

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

ReliaGate: Reliability Routing for Low-Stakes Wearable Stress Prediction

arXiv:2608.15951v1 Announce Type: cross Abstract: We study when a wearable stress system should surface a prediction rather than change it. In low-stakes reflection and summary settings, aggregate accuracy is insufficient because withholding can reduce error while leaving some people with little or no information. We formulate fixed-label reliability routing: after a locked classifier emits a protocol-defined stress/non-stress label, a post-hoc gate surfaces that unchanged label or withholds it as unavailable. ReliaGate assembles established confidence, signal-quality/trust, agreement, train-standardized atypicality, and train-fitted geometry cues into a post-hoc correctness score. We evaluate four wearable datasets using subject-disjoint folds, validation-selected routing, paired held-out-subject intervals, and pooled and per-subject analyses. WESAD point estimates favored ReliaGate, UBFC-Phys primary coverage/risk intervals favored ReliaGate, and E4 checks were mixed. ReliaGate provi

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

GUIDER: Evaluating Goal-Free Human Intent Inference for Teleoperated Manipulation on Real-Robot Data

arXiv:2608.15446v1 Announce Type: cross Abstract: This paper presents an evaluation of a goal-free probabilistic framework for human intent inference during robotic manipulation. We deploy the Global User Intent Dual-phase Estimation for Robots (GUIDER) on data collected from a robotic arm to test the manipulation phase across various assistance scenarios, including making tea and fetching medicine. To support operation, we add online probability updates, workspace limits, support-plane filtering, and a grasping mode that prioritizes feasible grasp regions, all of which are tested on the recorded data while preserving its original temporal conditions. Across 20 manipulation steps in three scenarios, GUIDER estimated human intent within the correct grasp-candidate set in all cases and achieved a time to confident prediction of 3.7 s, a remaining time before first grasp of 49.6 s, a prediction stability of 96.4%, and a runtime of 4.857/4.474 s (mean/median) per perceptual phase of intent

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

From "What-If" to "What-Is": Counterfactual Thinking-Inspired Semantic Alignment for Visual Brain Decoding

arXiv:2608.15163v1 Announce Type: cross Abstract: Visual brain decoding reconstructs visual content perceived by a person from neural measurements such as fMRI, providing a computational approach to studying how visual information is represented in the brain. Recent multimodal representations and diffusion priors have improved reconstruction realism. However, visually plausible reconstructions may contain incorrect objects, attributes, or relations because a strong generative prior can complete content not sufficiently specified by the decoded representation. Conventional reconstruction metrics mainly assess the final image and may therefore obscure such semantic errors. We propose ConceptAlign, a counterfactual semantic alignment framework for visual brain decoding. ConceptAlign pools decoded visual tokens and projects them into a frozen text-embedding space, aligning the representation with the ground-truth caption while separating it from scene-preserving near-miss alternatives. Gen

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

Command-Space Counterfactual Explanations for Pareto-Conditioned Reinforcement Learning

arXiv:2608.14963v1 Announce Type: cross Abstract: Pareto Conditioned Networks learn multiple multi-objective reinforcement learning behaviours by conditioning a single policy on a desired return command. However, the local mapping from command and state to action remains opaque. We propose command-space counterfactual explanations for PCNs: given a fixed state, original command, and foil action, we search, in a black-box setting, for a minimally changed desired-return command under which the same trained policy would choose the foil. Our contributions are threefold. First, we formulate PCN explanations as return-command interventions, using a return-only PCN variant that avoids the added ambiguity of horizon-conditioning. Second, we adapt adversarial machine learning methods to reinforcement-learning explanations. Third, we introduce a boundary-seeded directional search that improves over purely local optimization in the command-action landscape, resulting in our proposed approach CF-Z

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

Position: AI Agents in Scientific Teams Should Be Studied as Human-Agent Systems

arXiv:2608.14667v1 Announce Type: cross Abstract: Large language model-based agents are increasingly deployed as collaborators in scientific discovery yet most current work focuses on the autonomous capabilities of "AI Scientists". We argue that this overlooks the social aspects of scientific teamwork, and that studying AI Scientists as human-agent systems (HAS)--where the unit of analysis is the human-agent pair--is both underexplored and undervalued. We establish these points through literature and empirical analysis, and highlight recent incidences and studies which show that deploying agents in science without accounting for human-agent dynamics introduces near-term risks, including reduced diversity of scientific inquiry. Through analysis of real-world case studies, we show that scientists and agents can augment each other's capabilities. We call for new research that adopts the HAS lens to develop mathematical frameworks for understanding and fostering human-AI synergy in scienti

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

Evaluating Multimodal LLMs across Text and Audio Modalities for Accessible Disaster Assistance

arXiv:2608.14651v1 Announce Type: cross Abstract: Effective disaster risk communication is a foundational humanitarian challenge, yet current emergency infrastructure fails to meet the needs of individuals with access and functional needs, including hard-of-hearing individuals, pregnant women, mothers with toddlers, and elderly individuals with dementia. Recent advancements in Artificial Intelligence (AI), especially Multi-Modal Large Language Models (MM-LLMs), demonstrate powerful capabilities to serve diverse users across text, audio, image, and video modalities within a single unified system, such as a chatbot. However, their suitability for deployment rests on a property that receives limited scrutiny, i.e., whether these systems produce consistent, actionable outputs regardless of the modality through which a user communicates. In this paper, we conduct a comprehensive analysis to understand the status of open-weight MM-LLMs using real emergency alert scenarios across four differe

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

iFuzz-Meta: An Interpretable Fuzzy Learning Framework Bridging Top-Down and Bottom-Up Knowledge Integration

arXiv:2608.14646v1 Announce Type: cross Abstract: Interpretable representation learning remains a key challenge in modern neural computation, particularly when models are expected not only to perform but also to explain their reasoning. This paper introduces iFuzz-Meta, an interpretable fuzzy rule-based learning framework that preserves human-understandable reasoning structures within modern neural architectures. Each fuzzy rule corresponds to a semantic and spatial prototype defined in the original feature space, enabling transparent inference and direct interpretability. Meta-learning is employed as an analytical paradigm to examine how these interpretable rules reorganize across tasks and domains, providing a principled means to link algorithmic adaptation with cognitive representation. A knowledge-guided regularization mechanism further enables a top-down-bottom-up integration, in which theoretical priors act as soft inductive biases while data-driven learning refines and extends t

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

Evaluating Beyond the Screen: Collective Assessment of AI-Generated Business Plans with Resource-Constrained Entrepreneurs

arXiv:2608.16886v1 Announce Type: new Abstract: Entrepreneurs increasingly use end-user generative AI technologies such as ChatGPT for high-stakes documents like loan applications and business plans, where AI-generated errors---a wrong price, a fabricated product---can affect loan or funding outcomes. Current approaches to supporting evaluation of AI-generated text assume a single user assessing output alone, on screen. This can be especially demanding for resource-constrained entrepreneurs, whose digital and AI skills vary widely. In this early-stage work, we explore how evaluation might instead be organized in a group setting and completed as a collective activity. We extended BizChat, an AI-powered business-planning tool, with an evaluation module that links each generated claim to the entrepreneur's original input. We partner with community organizations in Maryland---embedding BizChat within various entrepreneurship programs---where workshop attendees (N=14) evaluated their plans

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

Prediction market visualizations, betting, and uncertainty: A study of Reddit Posts and Comments

arXiv:2608.16814v1 Announce Type: new Abstract: Prediction market platforms present contracts about future events through visualizations that show probabilities, prices, trends, odds, and payout information. Although these visualizations often appear precise, they do not always show uncertainty directly. As a result, users infer uncertainty from market movement, visualization cues, and contextual information. In this paper, we examine how users interpret prediction market visualizations through a qualitative analysis of posts and comments from the Reddit community r/Kalshi. From an initial corpus of approximately 12,000 posts and 96,000 comments, we identified 360 posts containing prediction market visualizations and conducted a thematic analysis of annotated posts and related discussions. Our findings show that users infer uncertainty through several forms of interpretation: they interpret chart values, struggle with probability information displayed, bring in external knowledge, ques

Source ↗
technology Tue, 18 Aug 2026 00:00:00 -0400
arXiv cs.HC

Closing the Affective Loop: Multimodal Speaker-Listener Emotion-Dynamics-Aware Empathetic Social Robots

arXiv:2608.16686v1 Announce Type: new Abstract: Empathetic social robots should respond not only to what users say, but also to how their emotions dynamically evolve during interaction. However, existing empathetic dialogue systems are often text-centered and primarily model empathy as a one-way mapping from the user's emotion to the system response, limiting their ability to capture embodied speaker--listener affective exchange. We present AffectLoop, a multimodal speaker-listener emotion-dynamics-aware spoken dialogue system implemented on the Misty II robot. The system tracks the speaker's verbal and facial affective dynamics, estimates the robot listener's own verbal and behavioral affective state, and conditions LLM-based response generation on both affective streams. The robot then generates a short spoken empathetic response together with emotionally congruent embodied behavior, forming a closed speaker--listener affective loop. We evaluate the system in a pilot within-subject s

Source ↗
Showing 451–500 of 1631 signals
← Prev Page 10 of 33 Next →