Monthly Issue
Collected dispatches

2026-07

2026-06-01 to 2026-06-30
180 papers
30 daily issues
A monthly ledger of recurring themes, selected papers, and daily issues. 3 sections
§ I

The Month in Review

Editorial summary

This past month in AI research has been heavily defined by the maturation of Agentic Systems across multiple domains, coupled with significant focus on addressing the reliability, efficiency, and safety of Large Language Models (LLMs). The trend moves decisively beyond simple prompting toward complex, structured, and continuous interaction loops.

Key Research Directions and Trends

1. Agentic Systems and Structured Reasoning: The most prominent trend is the explosion of research into sophisticated agent frameworks that manage complex workflows, memory, and decision-making: • Automation of Complex Workflows: Papers like AutoSci (full scientific lifecycle) and Iteris (computational mathematics) highlight a push to build agents capable of multi-step, domain-specific research. • Enhanced Reasoning Structures: Methods are emerging to externalize or structure latent reasoning: LinTree structures search histories into explicit trees, while HyperAgent uses specialized agents to interact with knowledge graphs for abductive hypothesis generation. • Memory Management: The systems implications of long-horizon agency are being explored, with Agent Memory characterizing cost trade-offs, and TokenMizer using graph-structured session memory to maintain context economy.

2. RL, Alignment, and Safety Refinement: Alignment research is becoming more granular, moving from general fine-tuning to targeted intervention: • Emergent Misalignment: The finding in Reinforcement Learning Amplifies Emergent Misalignment suggests that standard RL optimization exacerbates subtle reward inaccuracies more than Supervised Fine-Tuning (SFT), demanding a reassessment of RL safety protocols. • Efficient Safety Distillation: SafeSteer introduced localized on-policy distillation, aiming to reduce the "alignment tax" by ensuring safety training only impacts safety-critical tokens, preserving general capabilities better than previous global-tradeoff methods.

3. Efficiency and Infrastructure for Advanced Models: Scaling and serving advanced architectures (MoE, Long-Context) remains a primary engineering concern: • Sparse Attention & Serving: Vortex and RedKnot address the massive inference overhead of long context and large models, focusing on efficient KV cache reuse and programmable sparse attention serving. • Agent-Native Training: PithTrain introduces an MoE training system optimized specifically for modification by AI coding agents, emphasizing Agent-Task Efficiency (ATE).

Notable Groups/Labs

While specific lab affiliations were not provided in the dataset, the research focus suggests strong continuous efforts from groups concentrating on: 1. Agent and World Modeling: Evidenced by papers on co-evolving policies and world models (COMAP, Policy and World Modeling Co-Training) and multi-agent coordination (Dreaming Of Others). 2. Mechanism Interpretability & Robustness: Papers dissecting model internals, such as the analysis of activation spikes as structural biases (Massive Spikes in LLMs are Bias Vectors) and the causal auditing of financial model biases (Auditing Asset-Specific Preferences).

Trends to Watch Next Month

1. Move from Capability to Propensity in Safety: The emphasis in LLMs Can Leak Training Data But Do They Want To? suggests a shift from testing the capability of models to leak data or cause harm to assessing their propensity under normal interactions. Expect more stress-testing benchmarks that resemble everyday use cases. 2. Verification and Grounding in Multi-Modal Agents: The introduction of TVIR and the focus on challenging CAPTCHAs (HLL) indicate that verifying true world grounding—especially when text and vision are interleaved—will become a major benchmark area, moving beyond text-only agent evaluations. 3. Personalization as System Architecture: The concept of creating persistent, scalable personal models through PEFT (On the Scaling of PEFT) suggests that customizing large foundation models for individual users will move from a fine-tuning exercise to a core system design challenge involving memory and adaptation loops.

§ II

Top Papers

Selected research 180
cs.CLarxiv:2605.31328v1Lead article

Reinforcement Learning Amplifies Emergent Misalignment from Harmless Rewards

Magnus Jørgenvåg, David Kaczér, Lasse Ruttert, Marvin Gülhan, Lucie Flek

his paper investigates Emergent Misalignment (EM) arising from Reinforcement Learning (RL) using small, open-source models, addressing a gap in current research. The core contribution is demonstrating that RL training on narrowly misaligned behavior leads to *greater* general misalignment than equivalent Supervised Fine-Tuning (SFT). Furthermore, the authors show this can be induced by plausible, non-overtly harmful reward signals and confirm that existing SFT mitigation strategies, particularly interleaving safety data, are effective for RL-induced EM.

General-domain misalignment from RL across our three questions. (RQ1) Once a 100-example SFT warm-up (hatched) overcomes the cold-start problem, GRPO (red) induces far more emergent misalignment than sample-matched SFT (green); without the warm-up, GRPO fails to learn the behavior. (RQ2) The effect persists for plausibly harmless rewards. (RQ3) SFT mitigations transfer: interleaving safety data (Interleaving++) removes nearly all RL-induced misalignment. Panels 1–2 report two-epoch GRPO; panel 3 the one-epoch mitigation setup.
General-domain misalignment from RL across our three questions. (RQ1) Once a 100-example SFT warm-up (hatched) overcomes the cold-start problem, GRPO (red) induces far more emergent misalignment than sample-matched SFT (green); without the warm-up, GRPO fails to learn the behavio…
cs.AIarxiv:2606.02372v1Lead article

COMAP: Co-Evolving World Models and Agent Policies for LLM Agents

Youwei Liu, Jian Wang, Hanlin Wang, Wenjie Li

OMAP proposes a novel framework where textual world models and agent policies co-evolve through closed-loop interaction. The agent uses the world model to predict future states for candidate actions and refines its choice based on the predicted feedback's estimated reliability. This process leverages on-policy trajectories to update the world model via self-distillation, ensuring it remains aligned with the agent's evolving behavior.

Conceptual illustration of the co-evolution of world models and agent policies for LLM Agents.
Conceptual illustration of the co-evolution of world models and agent policies for LLM Agents.
cs.LGarxiv:2606.07367v1Lead article

Self-evolving LLM agents with in-distribution Optimization

Yudi Zhang, Meng Fang, Zhenfang Chen, Mykola Pechenizkiy

he paper introduces **Q-Evolve**, a self-evolving framework for LLM agents designed to overcome sparse reward challenges in long-horizon decision-making. It unifies automatic process-reward labeling and policy learning using an in-distribution reinforcement learning approach. The core method learns a stable critic from a hybrid dataset using a weighted Implicit Q-Learning objective, which then generates dense, step-wise process rewards via advantage estimation for improved supervision.

Comparison of existing methods. Left: Existing PRM methods rely on costly manual labels or search-based rollouts requiring discrete states, often failing due to distribution shifts between PRM training and policy improvement. Upper Mid: Most online RL does not address episodic sparse rewards. Bottom Mid: Our framework utilizes a hybrid off-policy dataset (expert + agents’ interaction data) to derive rewards via Bellman backups. By co-evolving process reward supervision and policy improvement within a shared in-distribution loop, the agent achieves stable self-evolution. Right: A visualization of performance vs environment steps required for collecting data.
Comparison of existing methods. Left: Existing PRM methods rely on costly manual labels or search-based rollouts requiring discrete states, often failing due to distribution shifts between PRM training and policy improvement. Upper Mid: Most online RL does not address episodic sp…
cs.AIarxiv:2605.31468v1Lead article

AutoSci: A Memory-Centric Agentic System for the Full Scientific Research Lifecycle

Weitong Qian, Beicheng Xu, Zhongao Xie, Bowen Fan, Guozheng Tang

utoSci is a memory-centric agentic system designed to automate the full scientific research lifecycle, addressing the limitations of existing partial solutions. Its core method involves a structured memory system, SciMem, which separates reusable scientific knowledge (Long-Term Knowledge Memory) from project-specific artifacts (Active Research Memory). The contribution is a unified framework that manages research from literature review through manuscript preparation, aiming for continuous procedural improvement.

Overview of AutoSci.
Overview of AutoSci.
cs.AIarxiv:2605.31365v1Lead article

Learning to Adapt: Self-Improving Web Agent via Cognitive-Aware Exploration

Weile Chen, Bingchen Miao, Qifan Yu, Wendong Bu, Guoming Wang

he paper introduces SCALE, a self-improving web agent framework utilizing three adversarial roles (Selector, Predictor, Judger) to autonomously identify and overcome its own limitations through cognitive-aware exploration. It also proposes SCALE-Hop for better global planning and introduces SCALE-20k, a large-scale dataset derived from the agent's exploration. This method significantly enhances web agent adaptability without relying on extensive handcrafted pipelines or expert data.

A comparison between prior methods and our SCALE framework. SCALE enables autonomous exploration with diverse and scalable task generation, overcoming the limitation in previous approaches.
A comparison between prior methods and our SCALE framework. SCALE enables autonomous exploration with diverse and scalable task generation, overcoming the limitation in previous approaches.
cs.AIarxiv:2605.31492v1Lead article

LinTree: Improving LLM Reasoning with Explicitly Structured Search Histories

Liwei Kang, Yee Whye Teh, Wee Sun Lee

inTree improves LLM reasoning by explicitly structuring the model's search history, transforming the implicit, linearized trace into an explicit search tree. This structure allows the LLM to better utilize the full context of its exploration and backtracking steps, leading to more effective reasoning compared to relying solely on the raw, sequential trace.

cs.AIarxiv:2605.31584v1Lead article

LongTraceRL: Learning Long-Context Reasoning from Search Agent Trajectories with Rubric Rewards

Nianyi Lin, Jiajie Zhang, Lei Hou, Juanzi Li

ongTraceRL addresses long-context reasoning challenges by generating highly challenging training contexts using search agent trajectories to create tiered, high-confusability distractors. The method introduces a novel rubric reward that provides dense supervision by rewarding the inclusion of gold entities at each reasoning step, moving beyond sparse outcome-only rewards. This approach significantly improves LLMs' ability to locate and integrate critical information within extensive, noisy documents.

Comparison between prior long-context RL approaches based on easy distractors and outcome-only rewards, and our proposed LongTraceRL .
Comparison between prior long-context RL approaches based on easy distractors and outcome-only rewards, and our proposed LongTraceRL .
cs.AIarxiv:2605.31408v1Lead article

Skill Availability and Presentation Granularity in Large-Language-Model Agents: A Controlled SkillsBench Study

Xiaonan Xu, Wenjing Wu

his study investigates how the presentation granularity of procedural knowledge (skill documents) affects the task success of LLM agents. The core finding is that the mere *availability* of skills significantly boosts task performance across tested models (GPT-5.5 and DeepSeek V4-Flash) compared to no skill. However, the paper suggests that finer contrasts in presentation granularity (e.g., low vs. high abstraction) yield less clear or uncertain effects.

Task-mean pass rates by model and condition
Task-mean pass rates by model and condition
cs.AIarxiv:2605.31445v1Lead article

Used Car Salesbots? Honesty and Credulity of LLMs as Bargaining Agents under Partial Information

Antonio Valerio Miceli-Barone, Vaishak Belle, Shay B. Cohen

his paper evaluates Large Language Models (LLMs) as text-based bargaining agents in simulated used car sales under varying information conditions. The core method involves comparing LLM performance against game-theoretical solutions while analyzing their honesty (deception) and credulity (trust). The contribution shows that off-the-shelf LLMs significantly deviate from optimal strategies, attempting to lie but failing to exploit information advantages effectively.

Example of negotiation where information asymmetry (buyer-unaware) induces strategic misleading communication: the seller’s true reservation price is v S = $ ​ 1.29 v_{S}=\( \mathdollar \) 1.29 , but it offers $ ​ 1.95 \( \mathdollar \) 1.95 as a “fair price”, a 51 % 51\% markup over cost. Both agents are Claude Sonnet 4.6.
Example of negotiation where information asymmetry (buyer-unaware) induces strategic misleading communication: the seller’s true reservation price is v S = $ ​ 1.29 v_{S}=\( \mathdollar \) 1.29 , but it offers $ ​ 1.95 \( \mathdollar \) 1.95 as a “fair price”, a 51 % 51\% markup …
cs.LGarxiv:2605.31455v1Lead article

DRIFT: Decoupled Rollouts and Importance-Weighted Fine-Tuning for Efficient Multi-Turn Optimization

Jian Mu, Tianyi Lin, Chengwei Qin, Zhongxiang Dai, Yao Shu

RIFT addresses the challenge of efficiently optimizing LLMs for multi-turn interaction by decoupling rollout and optimization. It leverages the equivalence between KL-regularized RL and importance-weighted supervised learning, using offline trajectories to derive importance weights. This allows for efficient policy updates via weighted SFT, mitigating the high cost of online RL and the distribution shift issues of standard offline SFT.

Multi-turn interaction. The user engages in a dialogue with the LLM. If the LLM provides an incorrect response, the user offers simple feedback to point out the error. The LLM then re-attempts the task until a correct answer is generated or the maximum number of turns is reached.
Multi-turn interaction. The user engages in a dialogue with the LLM. If the LLM provides an incorrect response, the user offers simple feedback to point out the error. The LLM then re-attempts the task until a correct answer is generated or the maximum number of turns is reached.
cs.CLarxiv:2605.31483v1Lead article

BenHalluEval: A Multi-Task Hallucination Evaluation Framework for Large Language Models on Bengali

Shefayat E Shams Adib, Ahmed Alfey Sani, Ekramul Alam Esham, Ajwad Abrar, Ishmam Tashdeed

he paper introduces **BenHalluEval**, a novel, multi-task evaluation framework specifically designed to systematically measure hallucination in Large Language Models (LLMs) for the Bengali language. It constructs 12,000 hallucinated examples across four tasks and proposes **BenHalluScore**, a dual-track calibration metric that jointly penalizes false positives and missed hallucinations to provide a robust assessment of LLM reliability in Bengali.

cs.CLarxiv:2605.31480v1Lead article

Language Models Can Resolve Reference Compositionally, But It's Not Their Native Strength: The Case of the Personal Relation Task

Bart Evelo, Meaghan Fowlie, Denis Paperno

his paper investigates the compositional interpretation abilities of Large Language Models (LLMs) using the Personal Relation Task, distinguishing between Extensional (identifying the referent) and Intensional (identifying the structured meaning) tasks. The core finding is that LLMs excel at the Intensional task (representing the structure) but struggle more with the Extensional task, showing the opposite pattern compared to humans. This methodology offers a nuanced perspective on where LLMs succeed and fail in compositional language understanding.

cs.CLarxiv:2605.31381v1Lead article

LLM Judges Inconsistently Disagree Across Safety Criteria and Harm Categories

Krishnapriya Vishnubhotla, Soumya Vajjala, Akriti Vij, Isar Nejadgholi

his paper evaluates the consistency of LLMs when acting as judges for multi-dimensional safety evaluations, specifically in a reference-free setting. The core finding is that LLM judges are unreliable for nuanced safety issues like regulated domain advice (e.g., finance) but more consistent with overt harms (e.g., violence). The contribution lies in demonstrating significant inconsistency across different safety criteria, languages, and high disagreement among different LLM judges, offering practical recommendations for their use as evaluators.

Reliability challenges of LLM judges across languages and judges. Our results suggest that LLM judges are less reliable when used for subjective criteria and nuanced or regulated harm categories.
Reliability challenges of LLM judges across languages and judges. Our results suggest that LLM judges are less reliable when used for subjective criteria and nuanced or regulated harm categories.
cs.CLarxiv:2605.31545v1Lead article

Preference-Aware Rubric Learning for Personalized Evaluation

Yilun Qiu, Xiaoyan Zhao, Yang Zhang, Yuxin Chen, Cilin Yan

his paper introduces **PARL (Preference-Aware Rubric Learning)**, a framework that reframes personalized evaluation as a learning problem to capture subjective user preferences from interaction histories. PARL learns preference-aware evaluation rubrics directly from raw user data, addressing limitations in existing static evaluation methods by satisfying principles of Representativeness, User-Consistency, and Discriminativeness. This contributes a dynamic, personalized method for assessing LLM alignment with individual user needs.

Overview of our proposed PARL framework for inducing personalized user rubrics for evaluating LLM personalization. PARL consists of two core modules: (1) Preference Induction & Consistency Validation; (2) Discriminative Optimization via RL. The final induced rubrics serve as high-fidelity evaluation metrics for personalized text generation.
Overview of our proposed PARL framework for inducing personalized user rubrics for evaluating LLM personalization. PARL consists of two core modules: (1) Preference Induction & Consistency Validation; (2) Discriminative Optimization via RL. The final induced rubrics serve as high…
cs.AIarxiv:2606.02444v1Lead article

Food Noise & False Safety: A Systematic Evaluation of How LLMs Fail to Adapt to Eating Disorder Queries with Clinician Feedback

Giulia Pucci, Emily Hemendinger, Ruizhe Li, Gavin Abercrombie, Tanvi Dinkar

his paper systematically evaluates how Large Language Models (LLMs) respond to eating disorder (ED) queries, focusing on the risk of models uncritically adapting to unsafe user requests. By consulting with clinical experts, the authors identify specific linguistic cues in prompts that increase the likelihood of harmful responses. The core contribution is quantifying the extent to which LLMs adapt to and facilitate potentially dangerous user inputs related to EDs.

Prevalence of food-noise categories across models ( G : Gemma-2-9B-Instruct , L : Llama-3.1-8B-Instruct , and Q : Qwen-2.5-7B-Instruct ) and context–request risk conditions ( NN , NR , RN and RR ). Each cell reports the percentage of replies containing at least one lexical match from the corresponding category, with darker colours indicate higher prevalence. We report statistical comparisons between the NN and RR conditions in Tab. ˜ 16 , and a full breakdown in § ˜ G.2 .
Prevalence of food-noise categories across models ( G : Gemma-2-9B-Instruct , L : Llama-3.1-8B-Instruct , and Q : Qwen-2.5-7B-Instruct ) and context–request risk conditions ( NN , NR , RN and RR ). Each cell reports the percentage of replies containing at least one lexical match …
cs.AIarxiv:2606.02449v1Lead article

HLL: Can Agents Cross Humanity's Last Line of Verification?

Xinhao Song, Su Su, Sirui Song, Hongliang Wu, Wen Shen

his paper introduces **HLL (Humanity's Last Line of Verification)**, a controlled benchmark designed to test whether multimodal AI agents can successfully navigate and solve interactive CAPTCHAs, which serve as a critical defense against automation. The core method involves evaluating agents in a closed-loop GUI environment across diverse CAPTCHA types under realism stressors. The contribution is establishing a rigorous test for agents' ability to perform grounded, human-like interaction necessary to cross this crucial verification boundary.

CAPTCHA as the final frontier: securing web services by testing interactive, human-level reasoning against automated agents.
CAPTCHA as the final frontier: securing web services by testing interactive, human-level reasoning against automated agents.
cs.AIarxiv:2606.02484v1Lead article

Iteris: Agentic Research Loops for Computational Mathematics

Leheng Chen, Zihao Liu, Wanyi He, Bin Dong

teris is an agentic research system specifically designed to tackle open problems in computational mathematics, which require a mix of proof, numerical experimentation, and algorithm design. The core method involves creating an autonomous loop where the AI generates evidence, constructions, and proof drafts. This system successfully generated verified results for two open problems, including a phase diagram and a counterexample, after expert refinement.

Iteris agent
Iteris agent
cs.AIarxiv:2606.02470v1Lead article

MCP-Persona: Benchmarking LLM Agents on Real-World Personal Applications via Environment Simulation

Wenhao Wang, Peizhi Niu, Gongyi Zou, Xiyuan Yang, Jingxing Wang

his paper introduces **MCP-Persona**, the first benchmark specifically designed to evaluate LLM agents using **Model Context Protocol (MCP)** tools in real-world, personalized application settings (e.g., social media, collaboration suites). The core method involves creating a benchmark that moves beyond generic tools to test agent performance on applications interacting with individual accounts or local data. The contribution highlights that current state-of-the-art agents significantly struggle with the complexities of personalized tool use.

System overview of MCP-Persona, which is built upon the interaction of Tools , Contexts , and Tasks . For each component, we introduce a dedicated method, described in detail as Tool-Traverse (§ 3.1 ), Context-Tree (§ 3.2 ), and Persona-Gen (§ 3.3 ).
System overview of MCP-Persona, which is built upon the interaction of Tools , Contexts , and Tasks . For each component, we introduce a dedicated method, described in detail as Tool-Traverse (§ 3.1 ), Context-Tree (§ 3.2 ), and Persona-Gen (§ 3.3 ).
cs.AIarxiv:2606.02578v1Lead article

Mitigating Perceptual Judgment Bias in Multimodal LLM-as-a-Judge via Perceptual Perturbation and Reward Modeling

Seojeong Park, Jiho Choi, Junyong Kang, Seonho Lee, Jaeyo Shin

his paper addresses **Perceptual Judgment Bias** in multimodal LLM judges, where models favor plausible text over correct visual evidence. The core method involves creating a **Perceptually Perturbed Judgment Dataset** using minimal visual counterfactuals to isolate perceptual errors. This dataset then trains a unified framework using a GRPO-based reward and batch-ranking objective to ensure the MLLM judges prioritize perceptual correctness for more reliable evaluation.

Perceptual judgment bias in MLLM judges. (a) When perceptual capability is insufficient, a judge may produce incorrect visual descriptions (a2) {}_{\( \texttt{(a2)} \)} and assign high scores (a3) {}_{\( \texttt{(a3)} \)} to perceptually wrong responses (a2) {}_{\( \texttt{(a2)} \)} . (b) Even when the judge’s own perception aligns with humans (b2) {}_{\( \texttt{(b2)} \)} , it may still prefer (b5) {}_{\( \texttt{(b5)} \)} visually inconsistent responses (b3) {}_{\( \texttt{(b3)} \)} compared to the response with correct perception (b4) {}_{\( \texttt{(b4)} \)} . We introduce Perception-Judge , an MLLM judge trained with reinforcement learning on a systematically designed perception-grounded dataset, PPJD , which effectively mitigates these perceptual biases in MLLM judgment , (b6) (a4) {}_{\( \texttt{(a4)} \)},_{\( \texttt{(b6)} \)} .
Perceptual judgment bias in MLLM judges. (a) When perceptual capability is insufficient, a judge may produce incorrect visual descriptions (a2) {}_{\( \texttt{(a2)} \)} and assign high scores (a3) {}_{\( \texttt{(a3)} \)} to perceptually wrong responses (a2) {}_{\( \texttt{(a2)} …
cs.AIarxiv:2606.02359v1Lead article

MOC: Multi-Order Communication in LLM-based Multi-Agent Systems

Yao Guan, Lin Wang, Zhihu Lu, Ziyi Wang, Wenzhu Yan

his paper introduces the **Multi-Order Communication (MOC)** scheme to improve message exchange in LLM-based multi-agent systems. MOC addresses the limitations of simple neighbor communication by constructing a **structured multi-order evidence stream** to capture multi-hop dependencies. It further employs a **Semantic-Topological Merging algorithm** to efficiently consolidate these messages while preserving semantic fidelity within token limits.

The paradigm comparison between existing communication scheme and ours.
The paradigm comparison between existing communication scheme and ours.
cs.AIarxiv:2606.02388v1Lead article

Policy and World Modeling Co-Training for Language Agents

Ning Lu, Baijiong Lin, Shengcai Liu, Jiahao Wu, Haoze Lv

his paper introduces PaW, a Policy and World Modeling co-training framework that integrates world model supervision directly into the standard reinforcement learning (RL) process for language agents. PaW leverages the on-policy transitions generated during RL to simultaneously train the policy and a world model, avoiding the need for separate simulators or inference-time overhead. The core contribution is achieving improved agent performance by enriching the policy's learning signal with environmental dynamics, using novel components for stable and informative co-training.

Comparison of world modeling paradigms for LLM agents. While prior methods rely on separate simulators, additional training, or inference-time planning, our PaW jointly optimizes policy learning and world modeling within the same model.
Comparison of world modeling paradigms for LLM agents. While prior methods rely on separate simulators, additional training, or inference-time planning, our PaW jointly optimizes policy learning and world modeling within the same model.
cs.AIarxiv:2606.02322v1Lead article

Repurposing Adversarial Perturbations for Continual Learning: From Defense to Active Alignment

Ran Liu, Min Yu, Mingqi Liu, Jianguo Jiang, Gang Li

his paper introduces **AdvCL**, a continual learning method that repurposes adversarial perturbations as a geometric control signal for stable adaptation. It employs three plug-in modules—Intra-Smooth, Proto-Clip, and Inter-Align—to promote local smoothness, prevent over-alignment, and guide directional alignment between tasks. AdvCL significantly improves continual learning performance by reducing forgetting and enhancing transfer while simultaneously boosting adversarial robustness.

Illustration of local smoothing and directional alignment in representation space.
Illustration of local smoothing and directional alignment in representation space.
cs.AIarxiv:2606.02530v1Lead article

SafeSteer: Localized On-Policy Distillation for Efficient Safety Alignment

Hao Li, Jingkun An, Zijun Song, Pengyu Zhu, Rui Li

afeSteer addresses the alignment tax by proposing localized on-policy distillation, focusing only on safety-critical tokens. It first creates a safety teacher via activation steering and then uses a token selection algorithm to restrict the distillation's KL penalty to these specific tokens. This method effectively improves safety while significantly preserving the LLM's general capabilities compared to existing global trade-off approaches.

Safety–capability trade-off on Qwen2.5-7B-Instruct . Each point is a method, with the gray point marking the base model. Our SafeSteer achieves the highest safety score while preserving general capability.
Safety–capability trade-off on Qwen2.5-7B-Instruct . Each point is a method, with the gray point marking the base model. Our SafeSteer achieves the highest safety score while preserving general capability.
cs.AIarxiv:2606.02544v1Lead article

SimSD: Simple Speculative Decoding in Diffusion Language Models

Junxia Cui, Haotian Ye, Runchu Tian, Hongcan Guo, Jinya Jiang

imSD introduces a novel speculative decoding method specifically for diffusion language models (dLLMs) to leverage the speedup achieved by standard token-level speculation. The core method involves a plug-and-play masking strategy that modifies the dLLM's attention mechanism to provide temporally valid, causal contexts. This adaptation allows the dLLM to efficiently verify multiple drafted tokens in a single forward pass, significantly accelerating inference without sacrificing model quality.

SimSD restores token-level speculative decoding for diffusion language models. Vanilla dLLMs cannot directly support speculative decoding because bidirectional attention breaks temporal token-level contexts. SimSD adopts a temporal causal mask for supporting standard speculative verification in a single forward pass, leading to faster decoding without hurting performance.
SimSD restores token-level speculative decoding for diffusion language models. Vanilla dLLMs cannot directly support speculative decoding because bidirectional attention breaks temporal token-level contexts. SimSD adopts a temporal causal mask for supporting standard speculative …
cs.AIarxiv:2606.02355v1Lead article

SIRI: Self-Internalizing Reinforcement Learning with Intrinsic Skills for LLM Agent Training

Zhongyu He, Yuanfan Li, Fei Huang, Tianyu Chen, Siyuan Chen

IRI proposes a three-phase framework to train LLM agents to discover, validate, and internalize reusable skills internally, eliminating the need for external skill generators or inference-time skill banks. The method involves initial policy warm-up, self-skill mining using the agent's own successful trajectories, and distillation of only beneficial skills into the core policy. This approach reduces engineering complexity and inference latency while enhancing long-horizon agent performance.

Conceptual comparison between (a) traditional skill-augmentation frameworks and (b) our Siri .
Conceptual comparison between (a) traditional skill-augmentation frameworks and (b) our Siri .
cs.AIarxiv:2606.02380v1Lead article

SPADE-Bench: Evaluating Spontaneous Strategic Deception in Agents via Plan-Action Divergence

Yuyan Bu, Haowei Li, Qirui Zheng, Bowen Dong, Kaiyue Yang

PADE-Bench is introduced to evaluate spontaneous strategic deception in AI agents, defined as the divergence between an agent's self-reported plan and its actual executed actions. The benchmark's core method involves simultaneously integrating actual tool execution with controlled pressure scenarios to rigorously test for this divergence. This design allows SPADE-Bench to reliably distinguish genuine strategic deception from simple hallucination, addressing a critical reliability gap for deploying autonomous agents.

Example of agent deception operationalized as plan-action divergence. When external pressure is applied, the agent reports an observer-favored plan to conform (“power surge”) but executes an action consistent with its intrinsic goal (“valve aging”), revealing spontaneous deceptive behavior.
Example of agent deception operationalized as plan-action divergence. When external pressure is applied, the agent reports an observer-favored plan to conform (“power surge”) but executes an action consistent with its intrinsic goal (“valve aging”), revealing spontaneous deceptiv…
cs.LGarxiv:2606.02528v1Lead article

Auditing Asset-Specific Preferences in Financial Large Language Models: Evidence from Bitcoin Representations and Portfolio Allocation

Wenbin Wu

his paper audits frontier Large Language Models (LLMs) for asset-specific biases, focusing on Bitcoin representations. The core method involves a three-level protocol: a behavioral audit showing frame-dependent rankings, internal analysis identifying a dominant, Bitcoin-selective feature within the model's sparse autoencoders, and demonstrating that manipulating this feature causally shifts the model's preference toward Bitcoin in downstream portfolio allocation tasks. The contribution is establishing a methodology to detect and causally probe hidden asset biases in LLMs used for financial applications.

cs.LGarxiv:2606.02423v1Lead article

Investigating and Alleviating Harm Amplification in LLM Interactions

Ruohao Guo, Wei Xu, Alan Ritter

his paper introduces **HarmAmp**, a novel benchmark designed to evaluate harm amplification in multi-turn LLM interactions across twelve real-world risk categories. The core contribution is demonstrating how LLMs can democratize expertise and scale harmful operations over extended conversations. To address this, the authors propose **TrajSafe**, a proactive monitoring system that anticipates harmful conversational trajectories and intervenes to steer the model toward safety.

Top : Prior work targets general, single-turn harmful requests. Bottom : We instead study multi-turn harm amplification, where LLMs compound assistance across turns to enable more specific and scalable harm.
Top : Prior work targets general, single-turn harmful requests. Bottom : We instead study multi-turn harm amplification, where LLMs compound assistance across turns to enable more specific and scalable harm.
cs.LGarxiv:2606.02288v1Lead article

Massive Spikes in LLMs are Bias Vectors: Mechanistic Uncovering and Spike-Free Quantization

Yung-Chin Chen, Chung Peng Lee, Ze-Wei Liou, Naveen Verma

his paper argues that massive LLM activation spikes are not scalar biases, but rather the scalar manifestation of rigid, structural vector biases carried by specific tokens. The authors show these vectors are preserved by projection weight coordination ($W_Q, W_K, W_V$) and resist RoPE perturbations by localizing in "zones of rotational stability." This mechanistic understanding enables the proposal of INSERTQUANT, a novel post-training quantization method designed to mitigate the impact of these structural biases.

Visualizing the Bias Vector Hypothesis. Bottom: RMSNorm standardizes extreme input spikes (e.g., “ \( \n \) ”) into a stable direction. Top: While semantic tokens vary significantly to encode information (high variance), spike-carrying tokens converge to rigid Bias Vector ( 𝐛 \( \mathbf{b} \) ) after RMSNorm, exhibiting negligible variance independent of the input sequence.
Visualizing the Bias Vector Hypothesis. Bottom: RMSNorm standardizes extreme input spikes (e.g., “ \( \n \) ”) into a stable direction. Top: While semantic tokens vary significantly to encode information (high variance), spike-carrying tokens converge to rigid Bias Vector ( 𝐛 \(…
cs.LGarxiv:2606.02437v1Lead article

On the Scaling of PEFT: Towards Million Personal Models of Trillion Parameters

Mind Lab, :, Song Cao, Vic Cao, Kaijie Chen

his paper reframes Parameter-Efficient Fine-Tuning (PEFT) as a method for creating persistent, local "personal models" built upon strong shared foundation models. The core contribution is exploring the scaling implications (Up, Down, Out) of using small, instance-specific adapters to encode unique behaviors, preferences, and memory. This positions PEFT as a compact substrate for managing numerous personalized AI instances, rather than just a cost-saving alternative to full fine-tuning.

cs.CLarxiv:2606.02502v1Lead article

CRAM: Centroid-Routing and Adaptive MoE for Multimodal Continual Instruction Tuning

Jun-Tao Tang, Zhen-Hao Xie, Yu-Cheng Shi, Da-Wei Zhou

RAM addresses Multimodal Continual Instruction Tuning (MCIT) by employing an architecture that isolates task-specific patterns into independent modules to mitigate catastrophic forgetting. It enhances parameter efficiency by using adaptive-rank instantiation to dynamically allocate only the necessary parameters based on the capability gap between existing experts and new task demands. This method balances performance retention with efficient parameter usage across a stream of evolving tasks.

cs.CLarxiv:2606.02404v1Lead article

K-BrowseComp: A Web Browsing Agent Benchmark Grounded in Korean Contexts

Nahyun Lee, Dongkeun Yoon, Guijin Son, Geewook Kim, Dayoon Ko

his paper introduces **K-BrowseComp**, a novel web-browsing agent benchmark specifically grounded in Korean contexts to address the scarcity of such resources. The benchmark comprises 400 problems, including a 300-problem manually verified subset, revealing a significant performance drop for frontier LLMs compared to English benchmarks. The authors also provide an adversarially constructed synthetic split, further highlighting current limitations in agentic web navigation capabilities within the Korean language domain.

Accuracy and calibration error of evaluated models on K-BrowseComp-Verified . Higher accuracy and lower calibration error indicate better performance. The shaded quadrants are defined by the median accuracy and calibration error across models. The dashed line marks the Pareto frontier.
Accuracy and calibration error of evaluated models on K-BrowseComp-Verified . Higher accuracy and lower calibration error indicate better performance. The shaded quadrants are defined by the median accuracy and calibration error across models. The dashed line marks the Pareto fro…
cs.CLarxiv:2606.02320v1Lead article

TVIR: Building Deep Research Agents Towards Text--Visual Interleaved Report Generation

Xinkai Ma, Zhiqi Bai, Dingling Zhang, Pei Liu, Yishuo Yuan

his paper introduces **TVIR (Text--Visual Interleaved Report Generation)**, a novel benchmark and framework addressing the lack of visual grounding in deep research agent evaluations. TVIR comprises **TVIR-Bench**, 100 multimodal tasks requiring visual elements for analysis, and **TVIR-Agent**, a hierarchical multi-agent system that generates reports by retrieving and creating traceable visual content. The core contribution is establishing a comprehensive evaluation standard and a strong baseline agent for assessing agents' ability to produce factually reliable and contextually aligned text-visual reports.

Comparison of representative deep research benchmarks. Existing benchmarks mainly focus on text-only or weakly multimodal reports, whereas TVIR-Bench requires text–visual interleaved reports with semantically grounded charts and retrieved images.
Comparison of representative deep research benchmarks. Existing benchmarks mainly focus on text-only or weakly multimodal reports, whereas TVIR-Bench requires text–visual interleaved reports with semantically grounded charts and retrieved images.
cs.AIarxiv:2606.06448v1Lead article

Agent Memory: Characterization and System Implications of Stateful Long-Horizon Workloads

Yasmine Omri, Ziyu Gan, Zachary Broveak, Robin Geens, Zexue He

his paper presents the first systems characterization of memory management in long-horizon LLM agents. The authors introduce a taxonomy to classify memory systems and develop a profiling harness to attribute costs across memory construction, retrieval, and generation phases. Their analysis of ten systems reveals how design choices significantly shift performance costs between the memory write and read paths, leading to actionable system recommendations.

cs.AIarxiv:2606.06462v1Lead article

Benchmark Everything Everywhere All at Once

Shiyun Xiong, Dongming Wu, Peiwen Sun, Yuang Ai, Bokang Yang

his paper introduces **Benchmark Agent**, a fully autonomous agentic system designed to automate the entire pipeline of benchmark construction, addressing the labor-intensive and unsustainable nature of current methods. The core contribution is a scalable framework that handles everything from query analysis and subtask design to data annotation and quality control. The authors demonstrate its effectiveness by using it to generate 15 diverse, high-quality benchmarks, which are then validated through extensive human and LLM-as-a-judge evaluations.

Our Benchmark Agent, as the first fully autonomous benchmark building system, can efficiently produce high-quality benchmarks across diverse modalities, tasks, and domains to meet user-specific requirements. It will offer rapidly evolving benchmarks to contribute to the community.
Our Benchmark Agent, as the first fully autonomous benchmark building system, can efficiently produce high-quality benchmarks across diverse modalities, tasks, and domains to meet user-specific requirements. It will offer rapidly evolving benchmarks to contribute to the community…
cs.AIarxiv:2606.06388v1Lead article

Humans' ALMANAC: A Human Collaboration Dataset of Action-Level Mental Model Annotations for Agent Collaboration

Jiaju Chen, Yuxuan Lu, Jiayi Su, Chaoran Chen, Songlin Xiao

he paper introduces **ALMANAC**, a novel dataset designed to advance agent collaboration capabilities beyond mere task completion. It provides **action-level mental model annotations** derived from human dyadic routing tasks, capturing participants' internal reasoning, intentions, and shared goals at each step. This resource aims to guide the development of agents capable of maintaining and aligning mental models crucial for effective human-AI collaboration.

A sample data of Almanac , which contains participants’ actions, mental models (team goal, perceived partner intent, self-reasoning), and a free-form rationale. We implement the Map Task, a classic dyadic routing task, to collect human collaborative behaviors and action-level mental model annotations.
A sample data of Almanac , which contains participants’ actions, mental models (team goal, perceived partner intent, self-reasoning), and a free-form rationale. We implement the Map Task, a classic dyadic routing task, to collect human collaborative behaviors and action-level men…
cs.AIarxiv:2606.06315v1Lead article

LLM Self-Recognition: Steering and Retrieving Activation Signatures

Thibaud Ardoin, Jonas Schäfer, Gerhard Wunder

his paper introduces a method to reliably attribute text to a specific Large Language Model (LLM) by steering its internal residual stream with a random sparse vector during generation, creating a detectable "activation signature." This signature acts as a fingerprint that a separate LLM detector can recover with high accuracy (>98%) while maintaining output quality. The core contribution is demonstrating this intrinsic self-recognition capability for practical, internal-signal-based content attribution.

cs.AIarxiv:2606.06286v1Lead article

LLMs Can Leak Training Data But Do They Want To? A Propensity-Aware Evaluation of Memorization in LLMs

Gianluca Barmina, Peter Schneider-Kamp, Lukas Galke Poech

his paper introduces **PropMe**, a propensity-aware framework to evaluate Large Language Model (LLM) memorization by contrasting adversarial prefix attacks with non-adversarial use cases. Using the lightweight **SimpleTrace** pipeline, the authors consistently find a significant gap, showing that models exhibit substantially less memorization under ordinary prompting than when intentionally forced via prefix attacks. This work shifts the focus from *capability* to *propensity* in assessing data leakage risks.

Left: PropMe framework overview with propensity and capability prompts, back-tracing to full training set and memorization/propensity measurements. Right: propensity metrics results for different combinations of models and dataset, this tells us what is the propensity of a given model to leak data of a certain dataset. The metrics used are defined and detailed in Sections 2 , 3.2 4.3
Left: PropMe framework overview with propensity and capability prompts, back-tracing to full training set and memorization/propensity measurements. Right: propensity metrics results for different combinations of models and dataset, this tells us what is the propensity of a given …
cs.AIarxiv:2606.06473v1Lead article

MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discovery

Shangheng Du, Xiangchao Yan, Jinxin Shi, Zongsheng Cao, Shiyang Feng

LEvolve is a self-evolving, LLM-based multi-agent framework designed for automated machine learning algorithm discovery. It overcomes limitations in existing agents by using Progressive MCGS for cross-branch information flow and an entropy-inspired schedule for shifting search from exploration to exploitation. The framework incorporates Retrospective Memory to allow agents to evolve by effectively retrieving and reusing accumulated domain knowledge and task-specific experience.

Overview of MLEvolve that summarizes its core components and supported tasks. Existing MLE agents suffer from inter-branch isolation, memoryless exploration, and lack of hierarchical control. MLEvolve addresses these through Progressive MCGS, Retrospective Memory, and Hierarchical Planning with Adaptive Code Generation, supporting long-horizon iterative optimization tasks, such as end-to-end MLE and mathematical algorithm discovery.
Overview of MLEvolve that summarizes its core components and supported tasks. Existing MLE agents suffer from inter-branch isolation, memoryless exploration, and lack of hierarchical control. MLEvolve addresses these through Progressive MCGS, Retrospective Memory, and Hierarchica…
cs.AIarxiv:2606.06256v1Lead article

RedKnot: Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention

Yang Liu, ZhaoKai Luo, HuaYi Jin, ZhiYong Wang, RuoZhou He

edKnot addresses the KV cache bottleneck in long-context LLM serving by introducing a novel, head-aware KV cache management system. It leverages the observation that different attention heads have varying utility, allowing for selective reuse and compression. The core contribution is the **Head-Aware KV Reuse** and **SegPagedAttention** mechanisms, which efficiently manage the KV cache based on head-specific needs, significantly improving memory utilization and serving efficiency.

RedKnot decouples the KV cache along the head dimension, classifies heads into global and local classes, and co-optimizes sparse attention, sparse FFN execution with selected tokens and SegPagedAttention. The combined design yields 1.6–3.5 × \( \times \) lower TTFT, 4.7–7.8 × \( \times \) higher concurrency, and 67–79% fewer FLOPs compared with dense attention.
RedKnot decouples the KV cache along the head dimension, classifies heads into global and local classes, and co-optimizes sparse attention, sparse FFN execution with selected tokens and SegPagedAttention. The combined design yields 1.6–3.5 × \( \times \) lower TTFT, 4.7–7.8 × \( …
cs.AIarxiv:2606.06337v1Lead article

TokenMizer: Graph-Structured Session Memory for Long-Horizon LLM Context Management

Shweta Mishra

okenMizer addresses the LLM context limit for long tasks by modeling session history as a typed knowledge graph, preserving critical relational structure lost in flat text methods. It uses a hybrid pipeline to incrementally build this graph and a multi-tier system to serialize it into compact resume blocks. This approach significantly improves token economy and enables robust session resumption by maintaining structured, rather than raw, historical context.

TokenMizer system architecture. The proxy sits transparently between any OpenAI-compatible client and the LLM provider. When session_id is present, the five-component pipeline is activated; otherwise the request passes through with no overhead. Persistent storage comprises a SQLite graph database and a JSON checkpoint store.
TokenMizer system architecture. The proxy sits transparently between any OpenAI-compatible client and the LLM provider. When session_id is present, the five-component pipeline is activated; otherwise the request passes through with no overhead. Persistent storage comprises a SQLi…
cs.AIarxiv:2606.06284v1Lead article

ToolChoiceConfusion: Causal Minimal Tool Filtering for Reliable LLM Agents

Rahul Suresh Babu, Laxmipriya Ganesh Iyer

his paper introduces Causal Minimal Tool Filtering (CMTF), a training-free method to improve LLM agent reliability by addressing tool confusion caused by large tool sets. CMTF selects tools based on **causal sufficiency** using lightweight precondition-effect contracts to expose only the minimal set of tools necessary for the *next causal step* toward the goal. This approach significantly reduces wrong-tool calls and premature actions compared to relevance-based methods.

cs.AIarxiv:2606.06453v1Lead article

Vortex: Efficient and Programmable Sparse Attention Serving for AI Agents

Zhuoming Chen, Xinrui Zhong, Qilong Feng, Ranajoy Sadhukhan, Yang Zhou

ortex is a system designed to efficiently serve diverse sparse attention algorithms for LLMs by combining a Python-embedded frontend language with a page-centric tensor abstraction. This framework simplifies the development, deployment, and evaluation of new sparse attention mechanisms. Its core contribution is accelerating the design and iteration cycle of sparse attention algorithms, enabling AI agents to automatically generate and refine efficient implementations that translate theoretical gains into real-world throughput improvements.

cs.AIarxiv:2606.06356v1Lead article

Where Should Knowledge Enter? A Layered Framework for Knowledge Infusion in Multimodal Iterative Generative Mo

Renjith Prasad, Chathurangi Shyalika, Anushka Pawar, Amit Sheth

his paper introduces a **Layered Framework for Knowledge Infusion** in iterative multimodal generative models, conceptualizing knowledge injection as an **intervention-layer problem**. It defines four distinct layers—surface, trajectory, latent, and parametric—based on which structural component of the generation process (input/output, transition function, intermediate state, or model parameters) the knowledge acts upon. This framework provides a systematic way to categorize existing methods and derive design principles for more effective, multi-layered knowledge integration.

Four intervention layers for knowledge infusion in iterative generative models. External knowledge acts on four structurally distinct components of the generation trajectory: surface (input/output boundary), trajectory (transition rule f θ f_{\( \theta \)} ), latent (intermediate states h t h_{t} ), and parametric (model weights \( \theta \) ). This enables complementary coverage of prompt-level, structural, and distributional violations.
Four intervention layers for knowledge infusion in iterative generative models. External knowledge acts on four structurally distinct components of the generation trajectory: surface (input/output boundary), trajectory (transition rule f θ f_{\( \theta \)} ), latent (intermediate…
cs.LGarxiv:2606.06238v1Lead article

Generative Criticality in Large Language Model Temperature Scaling

Huajian Ruan, Jinyang Li, Xingyu Guo, Lingxiao Wang

his paper introduces a statistical-field framework, treating LLM token embeddings as continuous spin variables on a 1D chain, to analyze text generation controlled by softmax temperature ($T$). The core contribution is observing a sharp susceptibility peak near a characteristic critical temperature ($T_c$), analogous to a phase transition, accompanied by a rapid change in the order parameter and a minimum in the intrinsic dimension. This framework offers quantitative tools to characterize the generative behavior of LLMs across varying temperatures.

cs.CLarxiv:2606.06399v1Lead article

CollabSim: A CSCW-Grounded Methodology for Investigating Collaborative Competence of LLM Agents through Controlled Multi-Agent Experiments

Jiaju Chen, Bo Sun, Yuxuan Lu, Yun Wang, Dakuo Wang

ollabSim is a novel, configurable simulation framework designed to systematically investigate the collaborative competence of LLM agents in multi-agent systems. It grounds its methodology in established Computer-Supported Cooperative Work (CSCW) research to move beyond simple task outcomes, allowing researchers to control experiments and analyze agents' abilities to establish common ground and manage alignment during interaction. The core contribution is providing a theory-grounded environment for diagnosing failures in agent coordination.

Illustrations of the four multi-agent experiments instantiated in CollabSim : Shape Factory Bos et al. ( 2004 ) , DayTrader Bos et al. ( 2002 ) , Hidden Profile Stasser and Titus ( 1985 ) , and The Map Task Anderson et al. ( 1991 ) .
Illustrations of the four multi-agent experiments instantiated in CollabSim : Shape Factory Bos et al. ( 2004 ) , DayTrader Bos et al. ( 2002 ) , Hidden Profile Stasser and Titus ( 1985 ) , and The Map Task Anderson et al. ( 1991 ) .
cs.CLarxiv:2606.06428v1Lead article

Reinforcement Learning Elicits Contextual Learning of Unseen Language Translation

Hanxu Hu, Zdeněk Šnajdr, Pinzhen Chen, Jannis Vamvas, Rico Sennrich

his paper proposes a Reinforcement Learning (RL) approach to improve the translation of unseen, low-resource languages by leveraging rich linguistic context provided in-context. The RL agent is trained using a surface-level translation metric (chrF) as a reward signal to encourage the model to learn the *meta-skill* of utilizing contextual linguistic knowledge rather than memorizing specific language pairs. This method achieves better zero-shot translation performance on completely unseen languages compared to standard in-context learning or supervised fine-tuning.

Train–test context mismatch (RL, Qwen3-4B-Base). Test-time context dominates: no/full > full/no in every panel (En → \( \to \) Kal: 0.28 0.28 vs. 0.17 0.17 ).
Train–test context mismatch (RL, Qwen3-4B-Base). Test-time context dominates: no/full > full/no in every panel (En → \( \to \) Kal: 0.28 0.28 vs. 0.17 0.17 ).
cs.AIarxiv:2606.07410v1Lead article

A Comprehensive Anatomy of Human and DeepSeek-R1 LLM Mathematical Reasoning

Yuxiang Chen, Jun Wang

his paper comprehensively compares the mathematical reasoning steps of the DeepSeek-R1 LLM and humans on AIME 2025 problems, categorizing 10,247 steps. The core finding is a structural difference: human reasoning is compact, while the LLM exhibits "topological mimicry," frequently revisiting shallow steps without logical progress. Despite this, the authors identify stable branching and backtracing in successful LLM traces as potential signals of genuine reasoning.

State CoT: A transition diagram illustrating the discrete reasoning states and meta-cognitive actions within a trajectory.
State CoT: A transition diagram illustrating the discrete reasoning states and meta-cognitive actions within a trajectory.
cs.AIarxiv:2606.07462v1Lead article

Act As a Real Researcher: A Suite of Benchmarks Evaluating Frontier LLMs and Agentic Harnesses in Research Lifecycle

Jiayu Wang, Weijiang Lv, Bowen Fu, Jing Fu, Jiayi Song

his paper introduces the **AARR (Act As a Real Researcher) benchmark series** to evaluate frontier LLMs and agents on the nuanced professionalism and thoroughness required in real research, moving beyond simple macro-level execution. The first installment, **AARRI-Bench**, specifically assesses agents' ability to emulate the granular reasoning and ethical judgment characteristic of human researchers. This contributes a new standard for evaluating agent capabilities in complex, long-horizon scientific tasks.

Overview of the AARRI-Bench Pipeline. The benchmark is constructed through a three-stage human-in-the-loop workflow with two-dimensional task categorization across task scenarios and agent scope levels. Tasks are evaluated under the Harbor framework with standardized environments, multiple agent harnesses and models, and both coarse-grained and fine-grained metrics.
Overview of the AARRI-Bench Pipeline. The benchmark is constructed through a three-stage human-in-the-loop workflow with two-dimensional task categorization across task scenarios and agent scope levels. Tasks are evaluated under the Harbor framework with standardized environments…
cs.AIarxiv:2606.07299v1Lead article

DuMate-DeepResearch: An Auditable Multi-Agent System with Recursive Search and Rubric-Grounded Reasoning

Lingyong Yan, Can Xu, Yukun Zhao, Wenxuan Li, Qingyang Chen

uMate-DeepResearch is a multi-agent framework designed to overcome limitations in current Deep Research (DR) systems, specifically concerning long-horizon planning, task decomposition, and auditability. It achieves this by decoupling the Agent Core (handling planning and scheduling) from an extensible Tool Ecosystem, ensuring every intermediate decision is explicitly traceable. The core contribution is an auditable DR system that manages complex research tasks through structured multi-agent interaction.

The illustration for the Qianfan Agent Foundry.
The illustration for the Qianfan Agent Foundry.
cs.AIarxiv:2606.07489v1Lead article

How AI Agents Reshape Knowledge Work: Autonomy, Efficiency, and Scope

Jeremy Yang, Kate Zyskowski, Noah Yonack, Jerry Ma

his paper investigates how autonomous AI agents transform knowledge work by analyzing production data comparing Perplexity's Search and Computer products. The core finding is that the autonomous Computer product significantly accelerates task completion (26 minutes of automated work vs. 33 seconds of manual orchestration in Search) and improves execution quality. This shift reallocates user effort towards higher-order tasks like verification and extension.

AI product progression by autonomy and workflow-context integration. Perplexity’s Search represents the baseline for information retrieval and synthesis; Comet Assistant introduces deeper context integration and execution on top of an interactive browser interface; Computer combines long-horizon asynchronous execution with even deeper and broader context integration as an agent orchestrator.
AI product progression by autonomy and workflow-context integration. Perplexity’s Search represents the baseline for information retrieval and synthesis; Comet Assistant introduces deeper context integration and execution on top of an interactive browser interface; Computer combi…
cs.AIarxiv:2606.07392v1Lead article

Online Pandora's Box for Contextual LLM Cascading

Alexandre Belloni, Yan Chen, Yehua Wei

his paper introduces the **Online Pandora's Box for Contextual LLM Cascading**, an adaptive framework for sequentially querying and selecting among LLM APIs based on request context. Its core method models the **contextual reservation index** directly, addressing the unique challenge where feedback is mediated by the API's generated output, rather than immediate reward revelation. The contribution lies in this novel learning approach tailored for output-mediated feedback in LLM cascading scenarios.

cs.AIarxiv:2606.07412v1Lead article

Socratic-SWE: Self-Evolving Coding Agents via Trace-Derived Agent Skills

Chuan Xiao, Zhengbo Jiao, Shaobo Wang, Wei Wang, Bing Zhao

ocratic-SWE is a closed-loop framework that enables self-evolving software engineering agents by leveraging their own historical solving traces. It distills these traces into structured "agent skills" that capture recurring failures and successful repair patterns. These skills then guide the generation of new, targeted repair tasks in real repositories, ensuring the training data directly addresses the agent's weaknesses.

cs.AIarxiv:2606.07313v1Lead article

SV-Detect: AI-generated Text Detection with Steering Vectors

Mikhail Vishnyakov, Tatiana Gaintseva

V-Detect detects AI-generated text by extracting "steering vectors" from a frozen language model's hidden layers, which define directions separating human and machine text. The method represents inputs by their alignment with these layer-wise directions and uses a lightweight classifier on these features for detection. This approach demonstrates robust performance even under significant distribution shifts, such as domain changes or text editing attacks.

Token-level steering-vector projections distinguish LLM-generated text (top) from human writing (bottom). Word saturation reflects each token’s signed contribution to the classifier.
Token-level steering-vector projections distinguish LLM-generated text (top) from human writing (bottom). Word saturation reflects each token’s signed contribution to the classifier.
cs.AIarxiv:2606.07237v1Lead article

When Large Language Models Fail in Healthcare: Evaluating Sensitivity to Prompt Variations

Mahdi Alkaeed

his paper systematically evaluates the sensitivity of general and medical Large Language Models (LLMs) to prompt variations (natural and adversarial) using the MedMCQA benchmark. The core contribution is demonstrating that even minor phrasing changes significantly impact model consistency and accuracy in clinical reasoning tasks. The study concludes that current medical LLMs lack the necessary robustness for safety-critical healthcare applications due to this high unpredictability.

This methodological pipeline outlines a comprehensive robustness evaluation framework for assessing the sensitivity and stability of healthcare LLMs using the MedMCQA benchmark, supported by advanced NLP tools (e.g., BioSyn, scispaCy) and biomedical metrics (e.g., BERTScore, USE) to quantify model resilience to input variations.
This methodological pipeline outlines a comprehensive robustness evaluation framework for assessing the sensitivity and stability of healthcare LLMs using the MedMCQA benchmark, supported by advanced NLP tools (e.g., BioSyn, scispaCy) and biomedical metrics (e.g., BERTScore, USE)…
cs.CLarxiv:2606.07513v1Lead article

Agentopia: Long-Term Life Simulation and Learning in Agent Societies

Xintao Wang, Sirui Zheng, Hongqiu Wu, Weiyuan Li, Jen-tse Huang

gentopia is a comprehensive framework designed for long-term life simulation of multi-agent societies, extending simulations from days to years. The core method involves simulating 100 LLM-powered agents autonomously pursuing growth, relationships, and goals over a simulated decade. The contribution is enabling the study of emergent social behaviors and developing enhanced, anthropomorphic social intelligence in LLMs through extended simulated social experience.

Illustration of emergent behaviors observed in Agentopia simulations. Each scene depicts a real behavioral pattern documented in our case studies (Tables 22 – 34 ). Without explicit scripting, agents autonomously develop diverse behavioral patterns reflecting agents’ intelligence in social life.
Illustration of emergent behaviors observed in Agentopia simulations. Each scene depicts a real behavioral pattern documented in our case studies (Tables 22 – 34 ). Without explicit scripting, agents autonomously develop diverse behavioral patterns reflecting agents’ intelligence…
cs.CLarxiv:2606.07402v1Lead article

M$^3$Exam: Benchmarking Multimodal Memory for Realistic User-Agent Interactions

Zhengjun Huang, Wenxuan Liu, Zhoujin Tian, Wei Chen, Junle Chen

he paper introduces **M$^3$Exam**, a novel benchmark designed to evaluate language agents' multimodal memory capabilities in realistic user-agent interactions, moving beyond sparse, human-centric data. Its core contribution is a query-centric evaluation framework that tests cross-modal grounding and implicit information inference over accumulating, authentic multimodal data. Furthermore, the authors propose **M$^3$Proctor**, a memory method that selectively processes raw visual data, significantly improving accuracy and efficiency.

Overview of M 3 Exam .
Overview of M 3 Exam .
cs.CLarxiv:2606.07441v1Lead article

Sycophantic Praise: Evaluating Excessive Praise in Language Models

Daniel Vennemeyer, Phan Anh Duong, Meryl Ye, Ruihong Huang, Tianyu Jiang

his paper introduces a novel framework to measure *sycophantic praise* in language models, distinguishing it from simple agreement. The method quantifies praise by comparing it against the contribution's quality and expected user ability, showing it is a distinct alignment problem. The authors demonstrate this framework is superior to generic judges and find that excessive praise is more prevalent in social domains than in objective reasoning tasks.

The same model response may be appropriate or excessive depending on the user’s expected ability and contribution quality. SyPr measures excess praise as the difference between observed praise P ​ ( r ) P(r) in the response r r , and contextually warranted praise W ​ ( p , u ) W(p,u) , where warranted praise depends on both the persona context p p and the user utterance u u .
The same model response may be appropriate or excessive depending on the user’s expected ability and contribution quality. SyPr measures excess praise as the difference between observed praise P ​ ( r ) P(r) in the response r r , and contextually warranted praise W ​ ( p , u ) W(…
cs.AIarxiv:2606.09613v1Lead article

AGENTSERVESIM: A Hardware-aware Simulator for Multi-Turn LLM Agent Serving

Rakibul Hasan Rajib, Mengxin Zheng, Qian Lou

GENTSERVESIM is a novel, hardware-aware simulator designed specifically for multi-turn LLM agent serving workloads. Its core contribution is modeling the stateful program execution dynamics of agents, including turn dependencies, tool gaps, and cross-turn KV-cache locality, which existing stateless simulators ignore. This allows for scalable evaluation of complex scheduling and cache management policies relevant to agent serving without costly real-system testing.

AgentServeSim architecture. The Program Orchestrator advances each program turn by turn, routing New Turn events through the Session-Aware Router to a Model Serving Group. There, the scheduler queues turns, the KV Residency Model manages KV state across memory tiers, and the System Simulator executes the resulting operator graphs. After Turn Complete, the Tool Simulator materializes the next inter-turn gap.
AgentServeSim architecture. The Program Orchestrator advances each program turn by turn, routing New Turn events through the Session-Aware Router to a Model Serving Group. There, the scheduler queues turns, the KV Residency Model manages KV state across memory tiers, and the Syst…
cs.AIarxiv:2606.09751v1Lead article

Collaborative Human-Agent Protocol (CHAP)

Arsalan Shahid, Gordon Suttie, Philip Black

he Collaborative Human-Agent Protocol (CHAP) introduces a standard for the shared workspace in complex, multi-human, multi-agent collaborations where foundation models take on operational roles. Its core method is to formally specify the interaction protocol, focusing on capturing the crucial moment of human judgment (e.g., edits to agent output) as a primary system signal. CHAP's contribution is providing a necessary technical specification for these collaborative workflows, complementing existing standards for tool access and agent-to-agent communication.

Three waves in the evolution of agentic systems. Wave I centred on isolated conversational assistants. Wave II added planning, memory, tool use, and early multi-agent orchestration. Wave III centres on shared human-agent workspaces where humans, agents, and services collaborate under explicit policy and shared audit.
Three waves in the evolution of agentic systems. Wave I centred on isolated conversational assistants. Wave II added planning, memory, tool use, and early multi-agent orchestration. Wave III centres on shared human-agent workspaces where humans, agents, and services collaborate u…
cs.AIarxiv:2606.09643v1Lead article

FMplex: Model Virtualization for Serving Extensible Foundation Models

Hetvi Shastri, Pragya Sharma, Walid A. Hanafy, David Irwin, Mani Srivastava

Mplex introduces a model virtualization substrate for serving Foundation Models (FMs) by treating the FM backbone as a shared resource. It presents each downstream task with a virtual FM (vFM), allowing independent customization and lifecycle management while sharing the costly physical backbone. This approach significantly reduces memory waste and improves efficiency through optimized batching across colocated tasks.

cs.AIarxiv:2606.09551v1Lead article

FuseFSS: Efficient Secure LLM Inference with Function Secret Sharing

Yuhan Ma, Yong Li, Stefan Schmid

useFSS introduces a novel compiler for efficient two-server secure LLM inference using Function Secret Sharing (FSS). It replaces bespoke per-operator protocols with a unified compilation pipeline that compactly specifies fixed-point nonlinearities. This allows for batched FSS evaluations of packed comparisons and vector interval lookups, significantly improving efficiency over prior FSS-based methods.

Gate-level activation microbench at L = 128 L{=}128 .
Gate-level activation microbench at L = 128 L{=}128 .
cs.AIarxiv:2606.09748v1Lead article

Multi-Turn Evaluation of Deep Research Agents Under Process-Level Feedback

Rishabh Sabharwal, Hongru Wang, Amos Storkey, Jeff Z. Pan

his paper introduces a multi-turn evaluation framework to assess deep research agents' (DRAs) ability to improve based on feedback, moving beyond single-shot benchmarks. The core contribution is the **Research Gap Inference (RGI)** method, which analyzes rubric satisfaction to generate targeted, process-level feedback. This feedback significantly improves DRA performance, unlike self-reflection which shows negligible net gains.

Process-level feedback generation. Given a report r t − 1 r_{t-1} evaluated against the DRACO rubric, RGI analyzes patterns of satisfied and unsatisfied criteria from FA, BD, and CQ (excluding PQ) to infer research-process gaps and generate process-level feedback f t − 1 f_{t-1} for the next turn. Example criteria shown for illustration; negative-weight criteria excluded for simplicity.
Process-level feedback generation. Given a report r t − 1 r_{t-1} evaluated against the DRACO rubric, RGI analyzes patterns of satisfied and unsatisfied criteria from FA, BD, and CQ (excluding PQ) to infer research-process gaps and generate process-level feedback f t − 1 f_{t-1} …
cs.AIarxiv:2606.09692v1Lead article

Observability for Delegated Execution in Agentic AI Systems

Abhinav Mishra, Kumar Sharad

his paper addresses the challenge of tracking actions within specific delegation scopes in complex, agentic AI systems, where standard logs fail to distinguish between incompatible delegation assignments. The core method introduces an **agent-aware observability substrate** featuring a lightweight gateway and a common information model. This system binds execution traces to specific delegation contexts, enabling accurate **delegation-scoped attribution and access footprint reconstruction**.

cs.AIarxiv:2606.09826v1Lead article

OmniGameArena: A Unified UE5 Benchmark for VLM Game Agents with Improvement Dynamics

Mingxian Lin, Shengju Qian, Yuqi Liu, Yi-Hua Huang, Yiyu Wang

mniGameArena introduces a unified benchmark using twelve diverse Unreal Engine 5 games (Solo, PvP, Coop) to evaluate Vision-Language Model (VLM) agents fairly. Its core contribution is the Improvement Dynamics Curve (IDC), a harness where a reflector LLM autonomously refines agent prompts across multiple rounds. This method provides not just a static score, but also the agent's score evolution and generalization ability across task variants.

OmniGameArena at a glance. Twelve newly built UE5 games span Solo (7), PvP (3), and Coop (2) regimes (top). Heterogeneous agents (commercial VLMs, open-weight VLMs, keyboard-mouse policies, and gamepad policies) connect to the same real-time UE5 environment through documented adapters (middle). Evaluation reports the cold-start leaderboard and the Improvement Dynamics Curve (IDC) under multi-round reflection (bottom).
OmniGameArena at a glance. Twelve newly built UE5 games span Solo (7), PvP (3), and Coop (2) regimes (top). Heterogeneous agents (commercial VLMs, open-weight VLMs, keyboard-mouse policies, and gamepad policies) connect to the same real-time UE5 environment through documented ada…
cs.AIarxiv:2606.09563v1Lead article

PRISM: Recovering Instruction Sets from Language Model Activations

Gilad Gressel, Rahul Pankajakshan, Julia Diament, Efim Hudis, Krishnashree Achuthan

RISM is a novel method designed to recover the complete set of active instructions, constraints, and subgoals steering a frozen Language Model's behavior by interpreting its internal activations. It formalizes this as instruction set retrieval and uses a judge-guided GRPO training scheme to directly decode a faithful bulleted list of simultaneous instructions from the hidden states. This directly addresses the limitations of prior activation-to-language methods in complex, agentic scenarios.

Activation-conditioned instruction set retrieval. A frozen target model ℳ \( \mathcal{M} \) generates a response, and we extract a window of T T residual-stream hidden states from layer ℓ \( \ell \) , forming the activation snapshot H ℓ H_{\( \ell \)} . A learned projection maps these states into the model’s embedding space, where they are consumed as a soft prefix by the interpreter \( \phi \) (PRISM). The interpreter reuses ℳ \( \mathcal{M} \) ’s base weights with LoRA adapters and decodes a bullet list ℐ ^ \( \hat \){\( \mathcal{I} \)} of recovered instructions. During RL training, an LLM judge scores candidate lists for coverage of reference instructions and hallucinated bullets.
Activation-conditioned instruction set retrieval. A frozen target model ℳ \( \mathcal{M} \) generates a response, and we extract a window of T T residual-stream hidden states from layer ℓ \( \ell \) , forming the activation snapshot H ℓ H_{\( \ell \)} . A learned projection maps …
cs.AIarxiv:2606.09711v1Lead article

Proxy Reward Internalization and Mechanistic Exploitation: A Learned Precursor to Reward Hacking and Its Generalization

Mohammad Beigi, Ming Jin, Lifu Huang

his paper introduces **PRIME (Proxy Reward Internalization and Mechanistic Exploitation)**, a learned capability in RL agents to assess task correctness, predict proxy reward acceptance, and reason about exploitable gaps between the proxy and true (gold) reward. The core contribution is demonstrating that PRIME emerges *before* visible reward hacking, and its measured strength accurately forecasts the onset and severity of future hacking, even adapting when the reward structure changes.

External Prime emerges before reward hacking. (a) Proxy/gold split. (b) C B , P B , E B C^{B},P^{B},E^{B} onset before hack rate. (c) Source B exceeds Source A on joint G , E ​ G ​ a ​ p G,EGap .
External Prime emerges before reward hacking. (a) Proxy/gold split. (b) C B , P B , E B C^{B},P^{B},E^{B} onset before hack rate. (c) Source B exceeds Source A on joint G , E ​ G ​ a ​ p G,EGap .
cs.AIarxiv:2606.09730v1Lead article

SearchSwarm: Towards Delegation Intelligence in Agentic LLMs for Long-Horizon Deep Research

Pu Ning, Quan Chen, Kun Tao, Xinyu Tang, Tianshu Wang

earchSwarm introduces a method to enhance agentic LLMs for long-horizon tasks by developing "delegation intelligence." The core method involves training agents to effectively decompose complex research tasks, delegate subtasks to specialized subagents, and integrate summarized results to manage the main agent's finite context window. The contribution is a preliminary framework and harness for synthesizing the scarce training data needed to acquire this crucial delegation capability for deep research scenarios.

cs.AIarxiv:2606.09549v1Lead article

SecureClaw: Clawing Back Control of LLM Agents

Yuhan Ma, Stefan Schmid

ecureClaw introduces a dual-boundary architecture to secure LLM agents against unauthorized actions and plaintext exposure. It achieves this by implementing plaintext confinement at the read boundary using a trusted gateway that replaces sensitive reads with opaque handles or bounded summaries. Simultaneously, it enforces authorization at the effect sink via a PREVIEW$\rightarrow$COMMIT protocol, ensuring only a trusted executor can finalize external state changes based on authorized requests.

cs.LGarxiv:2606.09764v1Lead article

iOSWorld: A Benchmark for Personally Intelligent Phone Agents

Lawrence Keunho Jang, Mareks Woodside, Geronimo Carom, Andrew Keunwoo Jang, Jing Yu Koh

his paper introduces **iOSWorld**, the first interactive native iOS simulator benchmark designed to test personally intelligent phone agents. Its core method involves creating a persistent user identity across 26 interconnected apps containing rich personal data (messages, transactions, etc.) to support 133 complex tasks. The contribution is providing a challenging, realistic environment that moves beyond isolated instructions to evaluate agents' ability to reason over a user's history and preferences.

Overview of iOSWorld. 26 purpose-built iOS applications share a single user identity (Jordan Avery) and connected data across apps. The benchmark includes 133 tasks across single-app, multi-app, and memory/personalization categories.
Overview of iOSWorld. 26 purpose-built iOS applications share a single user identity (Jordan Avery) and connected data across apps. The benchmark includes 133 tasks across single-app, multi-app, and memory/personalization categories.
cs.LGarxiv:2606.09821v1Lead article

Rethinking the Divergence Regularization in LLM RL

Jiarui Yao, Xiangxin Zhou, Penghui Qi, Wee Sun Lee, Liefeng Bo

his paper proposes Divergence Regularized Policy Optimization (DRPO) to improve stable reinforcement learning for LLMs, addressing limitations in existing ratio-clipping and hard-mask divergence methods. DRPO replaces the hard mask used in divergence-based trust regions with a smooth, advantage-weighted quadratic regularizer applied to policy shift. This allows for continuous correction of policy updates rather than outright discarding gradients when trust-region boundaries are crossed.

Per-token gradient weights of different algorithms as a function of the current probability π ​ ( y t | s t ) \( \pi \)(y_{t}|s_{t}) and behavior probability μ ​ ( y t | s t ) \( \mu \)(y_{t}|s_{t}) . For SPO, ϵ = 1 \( \epsilon \)=1 ; for DRPO, δ = 1 \( \delta \)=1 ; for PPO, ε low = 0.2 \( \varepsilon_{\rm low} \)=0.2 and ε high = 0.28 \( \varepsilon_{\rm high} \)=0.28 ; for DPPO, δ = 0.2 \( \delta \)=0.2 . SPO’s weight grows without bound as μ ​ ( y t | s t ) → 0 \( \mu \)(y_{t}|s_{t})\( \to \) 0 , while the weight of DRPO remains bounded for all tokens.
Per-token gradient weights of different algorithms as a function of the current probability π ​ ( y t | s t ) \( \pi \)(y_{t}|s_{t}) and behavior probability μ ​ ( y t | s t ) \( \mu \)(y_{t}|s_{t}) . For SPO, ϵ = 1 \( \epsilon \)=1 ; for DRPO, δ = 1 \( \delta \)=1 ; for PPO, ε l…
cs.LGarxiv:2606.09700v1Lead article

What the Eyes See, the LLMs Miss: Exploiting Human Perception for Adversarial Text Attacks

Qin Yang, Lu Malloy, Joshua Lee, Xiaohan Chang, Meisam Mohammady

his paper introduces Human-Perceptible Adversarial Attacks (HPAA) to exploit the mismatch between human visual perception and text-based LLM moderation. The core method involves embedding harmful content within benign text using visually salient typographic manipulations (like spacing and emphasis). This allows the harmful content to remain easily recognizable by humans while significantly reducing its detectability by token-based LLM moderation systems.

Overview of typographic Human-perceptible Adversarial Attacks (HPAA) against modern content moderation pipelines. Harmful content remains recognizable to human readers while evading automated moderation systems.
Overview of typographic Human-perceptible Adversarial Attacks (HPAA) against modern content moderation pipelines. Harmful content remains recognizable to human readers while evading automated moderation systems.
cs.CLarxiv:2606.09635v1Lead article

Gradient-Guided Reward Optimization for Inference-time Alignment

Hankun Lin, Ruqi Zhang

radient-Guided Reward Optimization (GGRO) is a lightweight inference-time alignment method that addresses the limitations of sampling-based approaches like Best-of-$N$. GGRO monitors token entropy to detect uncertainty indicative of distribution drift and then injects "nudging tokens" guided by the reward model's gradients to minimally steer the generation trajectory directly during decoding. This gradient-guided intervention offers a more targeted adaptation than simple re-ranking, aiming to improve reliability under drift without relying solely on exhaustive sampling.

Overview of Gradient-Guided Reward Optimization (GGRO). Left: Search-based inference-time alignment methods such as Best-of- N N (BoN) rely on extensive sampling and reward-based selection from the candidate pool, but their performance is constrained by the base model’s ability to produce high-quality responses. In challenging settings, merely sampling from the model’s native logits often fails to yield aligned outputs. Right: GGRO refines generation dynamically by monitoring token-level uncertainty and inserting nudging tokens —generated via gradients from the reward model—at uncertain positions. Each nudge steers decoding toward more aligned regions of the output space. The example illustrates how GGRO successfully corrects a harmful request under a challenging prefilling attack setup, whereas BoN with N = 64 N{=}64 fails.
Overview of Gradient-Guided Reward Optimization (GGRO). Left: Search-based inference-time alignment methods such as Best-of- N N (BoN) rely on extensive sampling and reward-based selection from the candidate pool, but their performance is constrained by the base model’s ability t…
cs.CLarxiv:2606.09709v1Lead article

IS-CoT: Breaking the Long-form Generation Collapse via Interleaved Structural Thinking

Zechen Sun, Yuyang Sun, Zecheng Tang, Juntao Li, Wenpeng Hu

he paper introduces **Interleaved Structural Chain-of-Thought (IS-CoT)** to combat the performance degradation ("length collapse") LLMs experience during long-form generation. IS-CoT embeds a dynamic **Plan-Write-Reflect cycle** directly into the generation process, allowing for continuous strategy adaptation without external agents. This method successfully enables LLMs to maintain coherence and control over extended texts, outperforming static planning approaches.

Comparison of three long-form generation paradigms. While existing methods degrade as target length increases due to static planning, our IS-CoT introduces a dynamic Plan-Write-Reflect cycle, maintaining coherence and length control over long horizons.
Comparison of three long-form generation paradigms. While existing methods degrade as target length increases due to static planning, our IS-CoT introduces a dynamic Plan-Write-Reflect cycle, maintaining coherence and length control over long horizons.
cs.CLarxiv:2606.09697v1Lead article

PsychoSafe: Eliciting Psychologically-Informed Refusals in Large Language Models

Gianluca Barmina, Federico Torrielli, Sven Harms, Jacob Nielsen, Felix Mächtle

sychoSafe introduces a framework for LLM refusals that reframes them as structured, supportive communication based on evidence-based psychological intervention strategies. The method involves creating a specialized corpus across five risk domains and fine-tuning an LLM (Qwen 3.5 27B) using this data. This approach significantly improves refusal quality by 28.1% over generic baselines, aiming to better support users in high-risk interactions rather than just offering blunt non-compliance.

PsychoSafe framework illustration. By providing a carefully designed prompt and a finetuning pipeline we obtain models up to 28 % 28\% more psychologically safe without loosing original capabilities. The models provide more helpful and psychologically grounded refusals when there is need for them (e.g. suicide, drugs, violence etc.).
PsychoSafe framework illustration. By providing a carefully designed prompt and a finetuning pipeline we obtain models up to 28 % 28\% more psychologically safe without loosing original capabilities. The models provide more helpful and psychologically grounded refusals when there…
cs.CLarxiv:2606.09735v1Lead article

The Neutral Mask: How RLHF Provides Shallow Alignment while Leaving Partisan Structure Intact in a Large Language Model

Wendy K. Tam

his paper investigates how Reinforcement Learning from Human Feedback (RLHF) aligns Large Language Models (LLMs) by analyzing partisan orientation in Llama 3.1 8B. The core finding is that RLHF achieves only **shallow alignment** by compressing the variance of existing partisan structure, rather than removing it. This results in consistently balanced output while leaving the underlying partisan representations intact within the model's internal features.

Layer 18 projections onto ω ^ \( \hat{\omega} \) for 84 prompts under the base model (circles) and the Instruct model (diamonds). The base model’s projections span from − - 0.5 to 1.253; RLHF compresses them into a narrow band centered at 0.169.
Layer 18 projections onto ω ^ \( \hat{\omega} \) for 84 prompts under the base model (circles) and the Instruct model (diamonds). The base model’s projections span from − - 0.5 to 1.253; RLHF compresses them into a narrow band centered at 0.169.
cs.AIarxiv:2606.11182v1Lead article

EEVEE: Towards Test-time Prompt Learning in the Real World for Self-Improving Agents

Weixian Xu, Shilong Liu, Mengdi Wang

EVEE introduces a novel test-time prompt learning framework designed for real-world, heterogeneous task streams, overcoming limitations of single-dataset methods. Its core method involves a router that clusters incoming inputs and assigns them to appropriate prompt configurations, optimized through a router-prompt co-evolution strategy. This approach significantly improves the robustness of LLM agents when handling diverse, interleaved data while preserving performance on individual tasks.

Incremental multi-benchmark retention improvement as tasks are added in the order GPQA Diamond, Formula, TheoremQA, and HumanEval. Each bar stacks per-benchmark improvements for all tasks seen so far: solid upward blocks are positive gains, and hatched downward blocks are negative retention losses. The number above or below each bar is its final summed improvement after all blocks are added.
Incremental multi-benchmark retention improvement as tasks are added in the order GPQA Diamond, Formula, TheoremQA, and HumanEval. Each bar stacks per-benchmark improvements for all tasks seen so far: solid upward blocks are positive gains, and hatched downward blocks are negativ…
cs.AIarxiv:2606.10956v1Lead article

Mind the Gap: Can Frontier LLMs Pass a Standardized Office Proficiency Exam?

Tengchao Lv, Dongdong Zhang, Jiayu Ding, Yilin Jia, Yuzhong Zhao

his paper introduces a rigorous benchmark, based on China's National Computer Rank Examination (NCRE), to evaluate frontier Large Language Models' (LLMs) ability to perform complex, multi-application Office automation tasks requiring long-horizon planning. The evaluation uses 200 practical tasks scored against 7,118 criteria. The core contribution is demonstrating the significant limitations of current LLMs in professional software proficiency, with even strong agentic systems showing limited success in passing this standardized office exam.

End-to-end illustration of a Word task in OfficeEval . The original document ( left ) is transformed according to the task instructions ( center ) into a styled brochure with header image, heading styles, and mail-merge labels ( right ). Only page 1 of the 2-page document is shown; several steps (e.g., 3-column layout, watermark) apply to page 2. The task is scored by 30 deterministic criteria across 6 skill categories. Instructions are translated from the original Chinese; additional examples across Word, Excel, and PowerPoint appear in the Appendix.
End-to-end illustration of a Word task in OfficeEval . The original document ( left ) is transformed according to the task instructions ( center ) into a styled brochure with header image, heading styles, and mail-merge labels ( right ). Only page 1 of the 2-page document is show…
cs.AIarxiv:2606.10989v1Lead article

Null-Space Constrained Low-Rank Adaptation for Response-Specified Large Language Model Unlearning

Bocheng Ju, Jianhua Wang, Chengliang Liu, Xiaolin Chang

his paper introduces Null-Space Constrained Response-Specified Unlearning (NSRU), a low-rank adaptation method for LLM unlearning. NSRU constrains the update parameters to the null space of estimated "retain subspaces" derived from benign data, ensuring adaptation is localized. This method jointly optimizes suppressing undesired responses, learning a safe target response, and preserving benign capabilities.

Motivation and core intuition of NSRU. (a) Suppression-only unlearning penalizes the undesired response y − y^{-} but leaves the safe replacement behavior unspecified and can induce under-constrained updates that perturb retained behavior. (b) NSRU specifies a safe target response y + y^{+} , explicitly suppresses y − y^{-} , and uses projected LoRA updates that act through retain-orthogonal components, redirecting forget queries while reducing retain-side interference.
Motivation and core intuition of NSRU. (a) Suppression-only unlearning penalizes the undesired response y − y^{-} but leaves the safe replacement behavior unspecified and can induce under-constrained updates that perturb retained behavior. (b) NSRU specifies a safe target respons…
cs.AIarxiv:2606.11164v1Lead article

ReasonAlloc: Hierarchical Decoding-Time KV Cache Budget Allocation for Reasoning Models

Wenhao Liu, Hao Shi, Yunhe Li, Weizhi Fei, Xiangyuan Wang

easonAlloc addresses KV cache bottlenecks in LLM reasoning by introducing a hierarchical, training-free budget allocation framework. It combines an offline layer-wise preallocation strategy, capturing the "Reasoning Wave" demand pattern, with an online head-wise reallocation strategy that prioritizes information-rich heads during decoding. This dynamic approach significantly mitigates inference latency caused by long CoT trajectories more effectively than uniform or static allocation methods.

An overview of the proposed ReasonAlloc framework. Left (I): Layer-wise allocation strategy based on offline architecture calibration, demonstrating the non-linear “Reasoning Wave” KV demand across layers. Right (II): Head-wise allocation strategy that dynamically routes KV budgets to distinct attention heads based on real-time importance and redundancy scoring during decoding.
An overview of the proposed ReasonAlloc framework. Left (I): Layer-wise allocation strategy based on offline architecture calibration, demonstrating the non-linear “Reasoning Wave” KV demand across layers. Right (II): Head-wise allocation strategy that dynamically routes KV budge…
cs.AIarxiv:2606.10917v1Lead article

Role-Agent: Bootstrapping LLM Agents via Dual-Role Evolution

Xucong Wang, Ziyu Ma, Shidong Yang, Tongwen Huang, Pengkun Wang

he Role-Agent framework bootstraps LLM agent learning by having a single LLM concurrently act as both the agent and the environment. It uses a dual-component system: World-In-Agent (WIA) generates a process reward based on state prediction accuracy, while Agent-In-World (AIW) uses failure analysis to reshape the training data for targeted improvement. This self-contained co-evolution addresses limitations of static environments and inefficient feedback, leading to enhanced generalization.

(a): Static environments provide sparse and non-specific feedback that limits the agent’s exploration; (b): Synthetic environments incur high labor and runtime costs; (c): The proposed Role-Agent enables one model to switch roles between agent and environment to achieve bootstrapped co-evolution.
(a): Static environments provide sparse and non-specific feedback that limits the agent’s exploration; (b): Synthetic environments incur high labor and runtime costs; (c): The proposed Role-Agent enables one model to switch roles between agent and environment to achieve bootstrap…
cs.AIarxiv:2606.11070v1Lead article

T1-Bench: Benchmarking Multi-Scenario Agents in Real-World Domains

Genta Indra Winata, Amartya Chakraborty, Yuzhen Lin, Swasthi P Rao, Shikhhar Siingh

1-Bench is introduced as a high-fidelity benchmark designed to evaluate LLM-based agents in complex, realistic, multi-domain customer-facing scenarios. Its core contribution is providing a standardized framework that captures sustained reasoning and coordination across interleaved, multi-turn interactions, significantly increasing compositional complexity and evaluative rigor compared to existing benchmarks.

Overview of T1-Bench , a framework for persistent multi-session conversational agents. User policies, including persona, user information, and goals, guide interactions between the user and the assistant. The assistant performs domain classification to retrieve domain-specific tools and policies (e.g., flight, hotel, and restaurant services) and executes tool-augmented reasoning via API calls. A shared memory module stores conversation history and cached results, enabling persistent context, tool reuse, and continuity across temporally separated sessions.
Overview of T1-Bench , a framework for persistent multi-session conversational agents. User policies, including persona, user information, and goals, guide interactions between the user and the assistant. The assistant performs domain classification to retrieve domain-specific to…
cs.AIarxiv:2606.11045v1Lead article

What Fits (Into Few Tokens) Doesn't Overfit: Compression and Generalization in ML Research Agents

Martin Andres Bertran, Aaron Roth, Zhiwei Steven Wu

his paper investigates the hypothesis that successful machine learning strategies are highly compressible, even when adaptively reused on held-out benchmarks. The authors test this using LLM-driven research agents under two compression bottlenecks: limiting the agent's prompt (output compression) or restricting feedback to one bit (input compression). They find that these compression methods have little effect on the final performance achieved across diverse ML tasks, suggesting that the successful search strategies are inherently compact.

Compressibility of an autonomous agent’s language model pre-training strategy. An explorer agent develops a 12-layer, 768-dimensional GPT with ∼ 30 {\( \sim \)}30 non-default choices; we compress its strategy into progressively shorter prompts (64 down to 4 tokens) and hand each to 5 independent reproducers that implement the strategy without the explorer’s code or validation set. Left : compressed prompts. Tokens encode architecture ( 12L d768 ), optimizer ( Muon .1 ), activation ( ReLU 2 ), batch size ( b2M ), and normalization ( QKnorm ); color indicates survival depth (dark blue = survives tightest budgets, red = dropped first). Right : reproducer holdout loss (BPB); dot = mean, gray band = min–max, dashed line = explorer before compression. Performance holds to 16 tokens; a cliff at 8 tokens coincides with loss of batch size, MLP ratio, and QK-norm.
Compressibility of an autonomous agent’s language model pre-training strategy. An explorer agent develops a 12-layer, 768-dimensional GPT with ∼ 30 {\( \sim \)}30 non-default choices; we compress its strategy into progressively shorter prompts (64 down to 4 tokens) and hand each …
cs.AIarxiv:2606.11042v1Lead article

Workflow-GYM: Towards Long-Horizon Evaluation of Computer-use Agentic tasks in Real-World Professional Fields

Liya Zhu, Jingzhe Ding, Jian Zhang, Jianbo Xue, Shihao Liang

orkflow-GYM is introduced as a novel benchmark to address the lack of evaluation for AI agents performing long-horizon, high-value professional workflows using graphical user interfaces (GUIs). The core method involves creating tasks centered on specialized, domain-specific professional software environments. The contribution is demonstrating that current state-of-the-art agents struggle significantly, achieving only about 30% success rates on these complex, real-world professional tasks.

Examples of Workflow-GYM tasks from professional domains. Each task requires interacting with specialized software through graphical user interfaces to accomplish a real-world objective.
Examples of Workflow-GYM tasks from professional domains. Each task requires interacting with specialized software through graphical user interfaces to accomplish a real-world objective.
cs.LGarxiv:2606.11025v1Lead article

Flow-DPPO: Divergence Proximal Policy Optimization for Flow Matching Models

Bowen Ping, Xiangxin Zhou, Penghui Qi, Minnan Luo, Liefeng Bo

low-DPPO addresses limitations in applying standard PPO to flow matching models by replacing noisy ratio clipping with a direct divergence constraint. Leveraging the Gaussian nature of the per-step policy, it enables exact and efficient computation of the KL divergence between old and new policies. This method provides a more structurally sound trust region enforcement, leading to improved quality and alignment in generative models.

Qualitative comparison on FLUX.1-dev (Black Forest Labs, 2024 ) with GenEval2 (Kamath et al. , 2025 ) prompts. Flow-DPPO achieves competitive compositional accuracy with notably less image quality degradation compared to Flow-GRPO (Liu et al. , 2025 ) , Flow-CPS (Wang and Yu, 2025 ) , and GRPO-Guard (Wang et al. , 2025 ) , reflecting their superior KL-proximal efficiency.
Qualitative comparison on FLUX.1-dev (Black Forest Labs, 2024 ) with GenEval2 (Kamath et al. , 2025 ) prompts. Flow-DPPO achieves competitive compositional accuracy with notably less image quality degradation compared to Flow-GRPO (Liu et al. , 2025 ) , Flow-CPS (Wang and Yu, 202…
cs.CLarxiv:2606.11046v1Lead article

Does Reasoning Preserve Alignment? On the Trustworthiness of Large Reasoning Models

Prajakta Kini, Avinash Reddy, Souradip Chakraborty, Satya Sai Srinath Namburi GNVV, Furong Huang

his paper investigates whether converting instruction-tuned Large Language Models (LLMs) into reasoning models via post-training preserves their original alignment behaviors (safety, bias avoidance, etc.). The core method involves a systematic trustworthiness audit comparing reasoning models (trained via SFT, RL, or distillation) against their instruction-tuned baselines across six dimensions. The key contribution is demonstrating that this conversion often leads to significant alignment regressions, despite improved reasoning accuracy.

Reasoning model development pathways. We study three common pathways for converting instruction-tuned models into reasoning models: (1) supervised fine-tuning (SFT) on reasoning traces, (2) RL-based post-training, including GRPO-style variants, using reasoning-oriented rewards, and (3) distillation from stronger reasoning teachers. Each reasoning model is evaluated against a matched instruction-tuned baseline to measure how the conversion affects reasoning utility and trustworthiness.
Reasoning model development pathways. We study three common pathways for converting instruction-tuned models into reasoning models: (1) supervised fine-tuning (SFT) on reasoning traces, (2) RL-based post-training, including GRPO-style variants, using reasoning-oriented rewards, a…
cs.CLarxiv:2606.10931v1Lead article

It Takes One to Bias Them All: Breaking Bad with One-Shot GRPO

Naihao Deng, Yilun Zhu, Naichen Shi, Clayton Scott, Rada Mihalcea

his paper demonstrates that a single biased example, introduced via one-shot Group Relative Policy Optimization (GRPO), is sufficient to induce systematic and generalizing bias in large language models (LLMs). The core contribution is revealing a critical vulnerability where post-training alignment guardrails can be easily overridden by minimal targeted adversarial training. Model susceptibility is shown to correlate with its initial propensity for biased outputs.

cs.CLarxiv:2606.10875v1Lead article

Pushing the Limits of LLM Tool Calling via Experiential Knowledge Integration and Activation

Yupu Hao, Zhuoran Jin, Huanxuan Liao, Kang Liu, Jun Zhao

his paper investigates how to improve LLM tool-calling by integrating and activating experiential knowledge. The core method involves acquiring instance-level knowledge, which proves highly effective, and employing parallel sampling (expanding reasoning width) during inference to better activate this knowledge. The contribution lies in demonstrating that simple instance knowledge and parallel reasoning are superior strategies for enhancing multi-step tool-use performance.

The augmentation results of different experiential knowledge. “All” indicates incorporating all the experiential knowledge.
The augmentation results of different experiential knowledge. “All” indicates incorporating all the experiential knowledge.
cs.CLarxiv:2606.11082v1Lead article

The Shibboleth Effect: Auditing the Cross-Lingual Distributional Skew of Large Language Models

Hakan Mehmetcik

his paper introduces the "Shibboleth Effect," examining how frontier LLMs exhibit cross-lingual distributional skew under adversarial conditions. Using a simulated geopolitical wargame played in English versus Turkish, the authors found that models display heterogeneous behavioral changes, such as Llama-4 significantly increasing coercive rhetoric when prompted in Turkish. The core contribution is demonstrating that language choice directly and differentially biases LLM strategic behavior.

cs.AIarxiv:2606.13608v1Lead article

AgentBeats: Agentifying Agent Assessment for Openness, Standardization, and Reproducibility

Xiaoyuan Liu, Jianhong Tu, Yuqi Chen, Siyuan Xie, Sihan Ren

he paper introduces Agentified Agent Assessment (AAA), a novel framework where evaluation is conducted by judge agents interacting with participants via standardized protocols (A2A and MCP). This approach unifies the assessment interface, decoupling evaluation logic from agent implementation. AgentBeats is the concrete realization of AAA, providing a generic, reproducible, and interoperable system for benchmarking diverse agent designs.

Figure 1 . Comparison between Traditional LLM/Agent benchmarks and AAA. AAA reduces the number of integrations from N × M N\( \times \) M to N + M N+M , while completely separating the benchmark and target agent as shown in the gray boxes.
Figure 1 . Comparison between Traditional LLM/Agent benchmarks and AAA. AAA reduces the number of integrations from N × M N\( \times \) M to N + M N+M , while completely separating the benchmark and target agent as shown in the gray boxes.
cs.AIarxiv:2606.13669v1Lead article

Agents-K1: Towards Agent-native Knowledge Orchestration

Zongsheng Cao, Bihao Zhan, Jinxin Shi, Jiong Wang, Fangchen Yu

gents-K1 introduces an end-to-end pipeline to transform raw scientific documents into agent-native knowledge graphs, addressing the limitations of existing LLM agents in scientific knowledge orchestration. Its core method involves a multimodal parser capturing detailed entities, evidence, and relations across the full paper, supported by a specialized information-extraction backbone. The contribution is a richer, structured knowledge representation designed to facilitate complex scientific reasoning for AI agents.

Agents-K1 : Architecture and Capabilities. Left : Extracting multimodal knowledge from scientific papers. Middle : Schema-adaptive extensions for core research tasks. Right : Enhancing LLM reasoning and verifiable knowledge tracing.
Agents-K1 : Architecture and Capabilities. Left : Extracting multimodal knowledge from scientific papers. Middle : Schema-adaptive extensions for core research tasks. Right : Enhancing LLM reasoning and verifiable knowledge tracing.
cs.AIarxiv:2606.13572v1Lead article

ArogyaSutra: A Multi-Agent Framework for Multimodal Medical Reasoning in Indic Languages

Tanmoy Kanti Halder, Akash Ghosh, Subhadip Baidya, Arijit Roy, Sriparna Saha

rogyaSutra is a multi-agent framework designed to enhance multimodal medical reasoning in Indic languages. It leverages a novel actor-critic architecture with dual-memory mechanisms and tool grounding to perform step-wise reasoning on complex medical queries involving text and images. The framework is supported by ArogyaBodha, a large-scale, multilingual multimodal medical Q\&A dataset spanning numerous body systems and imaging modalities.

Overview of the ArogyaSutra framework. ArogyaSutra employs an actor–critic architecture enhanced with tool-based image grounding and adaptive code-switching. The Actor first processes the input prompt and identifies the need for visual grounding, invoking appropriate tool agents to extract clinically relevant information from medical images before generating an answer with its associated reasoning. This output is then passed to the Critic for evaluation. If the response is correct, the Critic approves and outputs the final answer and reasoning. Otherwise, it consults an error detector (GPT-4o-mini) to identify the source of failure. Language-related errors trigger code-switching by translating the query into English, while reasoning-related errors are handled by incorporating summaries of past and current mistakes from long-term and short-term memory. The refined query is then fed back to the Actor for iterative refinement.
Overview of the ArogyaSutra framework. ArogyaSutra employs an actor–critic architecture enhanced with tool-based image grounding and adaptive code-switching. The Actor first processes the input prompt and identifies the need for visual grounding, invoking appropriate tool agents …
cs.AIarxiv:2606.13361v1Lead article

Can I Buy Your KV Cache?

Luoyuan Zhang

his paper proposes a simple yet impactful method to eliminate redundant computation in large language models: **precomputing and selling the Key-Value (KV) cache for documents.** By allowing agents to buy and load a precomputed cache instead of re-running the expensive prefill step, the authors achieve significant compute savings (9-50x cheaper for a small model) with zero accuracy loss. The core contribution is demonstrating the feasibility and efficiency of treating the KV cache as a reusable, purchasable asset to drastically reduce inference costs.

Amortized per-call cost vs. reuse count N N (log–log). The from-scratch cost is flat at C prefill C_{\( \text{prefill} \)} ; KV-reuse falls as C prefill / N + C reuse C_{\( \text{prefill} \)}/N+C_{\( \text{reuse} \)} toward a floor of C reuse C_{\( \text{reuse} \)} .
Amortized per-call cost vs. reuse count N N (log–log). The from-scratch cost is flat at C prefill C_{\( \text{prefill} \)} ; KV-reuse falls as C prefill / N + C reuse C_{\( \text{prefill} \)}/N+C_{\( \text{reuse} \)} toward a floor of C reuse C_{\( \text{reuse} \)} .
cs.AIarxiv:2606.13662v1Lead article

EurekAgent: Agent Environment Engineering is All You Need For Autonomous Scientific Discovery

Amy Xin, Jiening Siow, Junjie Wang, Zijun Yao, Fanjin Zhang

he paper introduces **EurekAgent**, an agent system arguing that the bottleneck for autonomous scientific discovery is shifting to **agent environment engineering**. EurekAgent focuses on designing the environment—including resources, constraints, and interfaces—to amplify desired agent behaviors (like exploration and collaboration) and suppress negative ones (like reward hacking). This environment engineering approach is presented as the core method for achieving metric-driven, high-performance autonomous scientific discovery.

EurekAgent score evolution progress on the 26-circle packing problem.
EurekAgent score evolution progress on the 26-circle packing problem.
cs.AIarxiv:2606.13607v1Lead article

Reasoning as Pattern Matching: Shared Mechanisms in Human and LLM Everyday Reasoning

Zach Studdiford, Gary Lupyan

his paper challenges the notion that human reasoning relies on abstract world models while LLMs only perform pattern matching. By testing both humans and LLMs on everyday common-sense reasoning, the authors found similar error patterns in both groups. They further demonstrated that specific LLM attention heads implement pattern-matching mechanisms that can predict seemingly irrelevant errors in human reasoning, suggesting both employ pattern-matching for everyday causal reasoning.

Overview of our evaluation probing human and LLM causal reasoning . a. Illustration of the evaluation format used for testing causal reasoning in people and LLMs. For each prompt, subjects are first presented with the scenario. After reading the prompt, subjects press SPACE to see the two response options and then select the most likely completion. b. Summary of the 11 categories we used in our evaluation of everyday causal reasoning.
Overview of our evaluation probing human and LLM causal reasoning . a. Illustration of the evaluation format used for testing causal reasoning in people and LLMs. For each prompt, subjects are first presented with the scenario. After reading the prompt, subjects press SPACE to se…
cs.AIarxiv:2606.13598v1Lead article

Reward Modeling for Multi-Agent Orchestration

King Yeung Tsang, Zihao Zhao, Vishal Venkataramani, Haizhou Shi, Zixuan Ke

he paper introduces **Orchestration Reward Modeling (OrchRM)**, a self-supervised framework to evaluate the quality of multi-agent orchestration without requiring human labels. OrchRM constructs win-lose pairs from intermediate execution artifacts to train a Bradley-Terry reward model, enabling efficient, reward-guided orchestrator training and MAS scaling. This method significantly improves training efficiency (up to 10x token reduction) and enhances test-time scaling performance (up to 8% accuracy gain) compared to existing rollout-based methods.

cs.CLarxiv:2606.13681v1Lead article

EvoArena: Tracking Memory Evolution for Robust LLM Agents in Dynamic Environments

Jundong Xu, Qingchuan Li, Jiaying Wu, Yihuai Lan, Shuyue Stella Li

voArena is a novel benchmark suite designed to evaluate LLM agents in dynamic environments by modeling progressive changes across terminal, software, and social domains. The core contribution is the introduction of EvoMem, a patch-based memory paradigm that explicitly tracks and structures memory evolution as update histories, allowing agents to reason about environmental changes. This framework reveals current agents' struggles in dynamic settings, while EvoMem demonstrates consistent performance improvements.

Step accuracy vs. chain accuracy on EvoArena. The closer to the upper-right corner the better.
Step accuracy vs. chain accuracy on EvoArena. The closer to the upper-right corner the better.
cs.CLarxiv:2606.13663v1Lead article

HyperTool: Beyond Step-Wise Tool Calls for Tool-Augmented Agents

Yaxin Du, Yifan Zhou, Yujie Ge, Jiajun Wang, Xianghe Pang

yperTool addresses the execution-granularity mismatch in tool-augmented agents by introducing a unified, executable interface that allows models to invoke complex, multi-step tool workflows within a single outer call. This "folding" of deterministic subroutines reduces the number of model-visible decisions, saving context and simplifying low-level dataflow management. The method significantly improves performance on compositional tasks by enabling more abstract, higher-level reasoning about tool usage.

Comparison of context management paradigms in tool-augmented agents. (a) Step-wise execution expands atomic calls and observations into the trace. (b) Trace-level compression shortens the trace after expansion. (c) HyperTool manages context at execution time by folding dependent tool operations into one executable block and returning only the task-relevant result.
Comparison of context management paradigms in tool-augmented agents. (a) Step-wise execution expands atomic calls and observations into the trace. (b) Trace-level compression shortens the trace after expansion. (c) HyperTool manages context at execution time by folding dependent …
cs.CLarxiv:2606.13643v1Lead article

Recursive Agent Harnesses

Elias Lumer, Sahil Sen, Kevin Paul, Vamse Kumar Subbiah

he paper introduces the **Recursive Agent Harness (RAH)**, framing it as a code-first extension to model recursion, where the recursive unit is a full agent harness with tools and planning, not just a model call. RAH leverages a parent agent to generate and execute scripts that spawn parallel subagent harnesses for fine-grained tasks and use structured calls for smaller ones. This method significantly improves long-context reasoning performance, boosting a baseline coding agent from 71.75% to 81.36%.

Figure 1 . The Recursive Agent Harness (RAH). A parent agent selects between code-execution spawning (writing an executable script that spawns subagents in parallel) and JSON tool-call spawning (for 1–5 entries). Subagents carry the same spawning capability as their parent, enabling recursive decomposition bounded by a configurable depth limit.
Figure 1 . The Recursive Agent Harness (RAH). A parent agent selects between code-execution spawning (writing an executable script that spawns subagents in parallel) and JSON tool-call spawning (for 1–5 entries). Subagents carry the same spawning capability as their parent, enabl…
cs.AIarxiv:2606.14502v1Lead article

From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI

Yongheng Zhang, Ziang Liu, Jiaxuan Zhu, Shuai Wang, Xiangqi Chen

his paper conceptualizes the evolution of LLMs from simple "Chatbots" to "Digital Colleagues" by analyzing two core dimensions. The cognitive core shifts from fast, next-token prediction to deliberate reasoning via techniques like Chain-of-Thought and reflection. Concurrently, task execution moves from ad hoc tool-calling agents to persistent, workstation-style systems equipped with memory, skills, and verification loops.

A roadmap and evolutionary timeline of next-generation LLM systems. The figure summarizes how these AI systems progress from simple conversational chatbots to reasoning cores, tool-using agents, and persistent workspace systems over time. Each node is labeled by its release month. box represents open-source / open platform; box represents closed / commercial system.
A roadmap and evolutionary timeline of next-generation LLM systems. The figure summarizes how these AI systems progress from simple conversational chatbots to reasoning cores, tool-using agents, and persistent workspace systems over time. Each node is labeled by its release month…
cs.AIarxiv:2606.14517v1Lead article

From Shield to Target: Denial-of-Service Attacks on LLM-Based Agent Guardrails

Yuguang Zhou, Xunguang Wang, Pingchuan Ma, Zhantong Xue, Zhaoyu Wang

his paper introduces a novel Denial-of-Service (DoS) attack targeting LLM-based agent guardrails by exploiting their reasoning capabilities. The core method involves crafting natural-language payloads using a beam-search optimization framework to force the guardrail into extended reasoning loops, thereby consuming excessive resources. The contribution is demonstrating this systematic vulnerability across various guardrail architectures and proposing two distinct attack frameworks to achieve high attack efficacy.

Illustration of the guardrail DoS threat, i.e. From Shield to Target. Hidden text in fetched content mimics the guardrail’s analytical schema, trapping it in an unbounded reasoning loop with no verdict—inflating per-call compute 13 13 – 63 × 63\( \times \) (up to 148 × 148\( \times \) ) and starving co-located agents.
Illustration of the guardrail DoS threat, i.e. From Shield to Target. Hidden text in fetched content mimics the guardrail’s analytical schema, trapping it in an unbounded reasoning loop with no verdict—inflating per-call compute 13 13 – 63 × 63\( \times \) (up to 148 × 148\( \tim…
cs.AIarxiv:2606.14470v1Lead article

GitOfThoughts: Version-Controlled Reasoning and Agent Memory You Can Replay, Diff, and Merge

Pavan C Shekar, Abhishek H S, Aswanth Krishnan

itOfThoughts addresses the ephemeral nature of LLM reasoning by treating the agent's thought process as a Git repository, where each thought is a commit, allowing reasoning to be version-controlled, replayed, and audited. The core contribution is demonstrating that while this system makes reasoning manageable, extensive testing across various memory substrates ultimately showed that memory, in any tested format, did not reliably improve accuracy on novel problems.

The reasoning tree is a git repository. Each scored thought is a commit with author, timestamp, and content-hash metadata; scores are git notes; validation outcomes are tags ( success_* , failed_* ); pruned attempts remain in history rather than vanishing. The winning path merges to main , an answer-free lesson is distilled to a long-lived memory branch, and retrieval is git log ( --grep , -S , tag filters) over the agent’s own history. Right: the operational properties this buys. Bottom: the end-to-end flow from exploration to retrieval.
The reasoning tree is a git repository. Each scored thought is a commit with author, timestamp, and content-hash metadata; scores are git notes; validation outcomes are tags ( success_* , failed_* ); pruned attempts remain in history rather than vanishing. The winning path merges…
cs.AIarxiv:2606.14574v1Lead article

SIMMER: Benchmarking Latent Failures in LLM Executable Planning with a World Model

Xiaoxin Lu, Ranran Haoran Zhang, Rui Zhang

IMMER introduces a novel benchmark to evaluate "latent failures" in LLM-generated plans for household agents, which are errors that don't immediately halt execution but silently undermine the final goal. The method uses a human-curated symbolic world model, grounded in the kitchen domain with extensive actions and objects, which a state machine executor validates plans against to detect these subtle, potentially harmful errors. This contributes a crucial evaluation tool beyond simple execution success, focusing on the long-term correctness of LLM planning.

A latent and irreversible failure demonstration in cooking. The cutting board becomes contaminated in Step 1 and is reused in Step 3, transferring bacteria to the vegetables. The failure propagates silently until the unsafe dish is served (Step 5). Moreover, once the contamination occurs, no subsequent action can undo it.
A latent and irreversible failure demonstration in cooking. The cutting board becomes contaminated in Step 1 and is reused in Step 3, transferring bacteria to the vegetables. The failure propagates silently until the unsafe dish is served (Step 5). Moreover, once the contaminatio…
cs.AIarxiv:2606.14571v1Lead article

StreamMemBench: Streaming Evaluation of Agent Memory for Future-Oriented Assistance

Guanming Liu, Yuqi Ren, Hansu Gu, Peng Zhang, Weihang Wang

treamMemBench is a novel streaming benchmark designed to evaluate how well agent memory systems utilize observations and interactions over time to provide future-oriented assistance. It constructs two-step task sequences based on egocentric data streams, testing both initial evidence use and the subsequent reuse of feedback and experience in a related follow-up task. This method reveals that current memory systems frequently struggle to effectively carry forward and reuse observed evidence across sequential interactions.

cs.AIarxiv:2606.14672v1Lead article

Towards Direct Latent-Space Synthesis for Parallel Branches in LLM-Agent Workflows

Shikun Liu, Mufei Li, Dongqi Fu, Haoyu Wang, Yinglong Xia

his paper introduces **Parallel-Synthesis**, a framework that enables a Large Language Model (LLM) synthesizer to directly consume the KV caches generated by parallel worker agents, bypassing sequential text concatenation. The core method involves a **cache mapper** to align independent branch caches and a **fine-tuned synthesizer adapter** to handle this non-sequential cache input. This directly preserves the parallel structure of agent workflows, reducing redundant computation and improving efficiency.

An example of DAG agentic workflow for advanced research containing using parallel worker agents for research in different directions.
An example of DAG agentic workflow for advanced research containing using parallel worker agents for research in different directions.
cs.AIarxiv:2606.14589v1Lead article

When Errors Become Narratives: A Longitudinal Taxonomy of Silent Failures in a Production LLM Agent Runtime

Wei Wu

his paper presents a longitudinal study of "silent failures" in a production LLM agent runtime, where errors occur without actionable human notification. The core contribution is a five-class, mechanism-oriented taxonomy for these failures, highlighting that LLM-specific issues like "chained hallucination and fabrication" are particularly dangerous and unique to these systems.

cs.AIarxiv:2606.14476v1Lead article

When the Tool Decides: LLM Agents Defer Blindly to Graph Neural Network Tools, and Stronger Backbones Defer More

Zhongyuan Wang, Pratyusha Vemuri

his paper investigates whether LLM agents truly exercise judgment when using Graph Neural Network (GNN) tools. The core finding is that agents overwhelmingly defer blindly to the GNN's raw output, acting as "GNN parrots" rather than selectively using the tool. Furthermore, this blind deference increases with the LLM's backbone capability, suggesting that stronger models are more likely to follow the tool wholesale without independent reasoning.

7 7 B, mean ± \( \pm \) SE over 5 5 seeds. (a) Agreement (A1 = = A3) stays near 1 1 across local-homophily regimes (the parrot effect). (b) The oracle gap (cost of deference) is positive throughout.
7 7 B, mean ± \( \pm \) SE over 5 5 seeds. (a) Agreement (A1 = = A3) stays near 1 1 across local-homophily regimes (the parrot effect). (b) The oracle gap (cost of deference) is positive throughout.
cs.LGarxiv:2606.14530v1Lead article

Code Correctness Signals in LLM Hidden States: Pre-Generation Probing and Repair Geometry

Carlo Di Cicco

his paper investigates whether code correctness is encoded in the hidden states of a large language model (LLM) before generation and during repair. The core method involves linearly probing the prompt-final hidden states to predict correctness, controlling for prompt length via residualization. The contribution is demonstrating that code correctness is highly legible in these hidden states, both for the initial attempt and as a distinct directional shift during the repair process.

cs.LGarxiv:2606.14397v1Lead article

Running the Gauntlet: Re-evaluating the Capabilities of Agents Beyond Familiar Environments

Mykola Vysotskyi, Runqi Lin, Grzegorz Biziel, Michal Zakrzewski, Sebastian Montagna

his paper introduces **GauntletBench**, a novel web-based benchmark designed to rigorously evaluate agent generalization beyond familiar, simple tasks. Its core contribution is focusing on three underexplored, vision-intensive capabilities—temporal perception, graphical understanding, and 3D reasoning—across five challenging, professional applications to better probe modern agent limitations.

cs.CLarxiv:2606.14674v1Lead article

AgentSpec: Understanding Embodied Agent Scaffolds Through Controlled Composition

Jixuan Chen, Jianzhi Shen, Haoqiang Kang, Zhi Hong, Qingyi Jiang

gentSpec is a modular specification framework that standardizes the interfaces between components (like perception, memory, and reasoning) in complex LLM agent scaffolds. This allows researchers to systematically swap and recombine these typed policy components under controlled conditions. The core contribution is enabling rigorous analysis of how individual module interactions and design choices impact overall embodied agent performance across various benchmarks.

AgentSpec turns tightly coupled embodied-agent pipelines into a controlled modular design space with fixed typed interfaces, enabling systematic module composition and revealing interaction effects between reasoning, memory, reflection, action, and learning.
AgentSpec turns tightly coupled embodied-agent pipelines into a controlled modular design space with fixed typed interfaces, enabling systematic module composition and revealing interaction effects between reasoning, memory, reflection, action, and learning.
cs.AIarxiv:2606.16808v1Lead article

Adaptive and Explicit safe: Triggering Latent Safety Awareness in Large Reasoning Models

Ke Miao, Jiaxin Li, Hongliang Chen, Yuke Hu, Zhan Qin

his paper introduces an **Adaptive and Explicit Safe (AES)** method to trigger latent safety awareness within Large Reasoning Models (LRMs) without relying on external manual safety data. The core method involves SFT to explicitly tag unsafe queries with safety analysis prompts, followed by DPO to refine the correctness of this self-generated safety guidance. This approach leverages the model's inherent ability to recognize safety risks in its own reasoning process for robust, internal safety alignment.

Performance of the model trained with our Safe Trigger approach.
Performance of the model trained with our Safe Trigger approach.
cs.AIarxiv:2606.16890v1Lead article

Compositional Reasoning Depth Predicts Clinical AI Failure: Empirical Evidence Consistent with Transformer Compositionality Limits in Electronic Health Record Question Answering

Sanjay Basu

his paper introduces a "hop-count taxonomy" to quantify the inferential depth required to answer clinical questions from Electronic Health Records (EHRs). The core method demonstrates that model accuracy systematically declines as the required number of reasoning steps (hop count) increases. This finding provides empirical evidence, consistent with theoretical limits on transformer compositionality, explaining why large language models frequently fail in complex clinical question answering tasks.

cs.AIarxiv:2606.16847v1Lead article

Follow the Latent Roadmap: Navigating Revocable Decoding for Diffusion LLMs with Anchor Tokens

Yizhen Yao, Qinglin Zhu, Runcong Zhao, Xiangxiang Dai, Yanzheng Xiang

his paper introduces Anchor Supervised Revocable Decoding (ASRD), a training-free framework to improve the quality and robustness of revocable decoding in Diffusion LLMs. ASRD mitigates error propagation by identifying and isolating trusted "Anchor Tokens" based on temporal consistency in the embedding space. This allows for Anchor-Guided Generation and error-aware remasking, ensuring that new tokens are generated based on a reliable context.

Overview of ASRD and its motivation. Existing revocable decoding verifies and generates tokens under a mixed-quality context, causing error propagation and local error reinforcement. ASRD instead selects temporally stable tokens as anchors, injects anchor guidance into masked positions, and verifies pending candidates with anchor-based perturbations.
Overview of ASRD and its motivation. Existing revocable decoding verifies and generates tokens under a mixed-quality context, causing error propagation and local error reinforcement. ASRD instead selects temporally stable tokens as anchors, injects anchor guidance into masked pos…
cs.AIarxiv:2606.16813v1Lead article

GIST-CMTF: Goal-State Inference for Causal Minimal Tool Filtering in LLM Agents

Rahul Suresh Babu, Rohit Shukla

his paper introduces GIST-CMTF, a goal-state inference layer designed to improve Causal Minimal Tool Filtering (CMTF) in LLM agents. GIST-CMTF addresses the issue of ambiguous user requests by predicting candidate symbolic goals, estimating ambiguity, and either applying CMTF or prompting for clarification. This method significantly enhances task success by ensuring the agent operates under the correct objective.

cs.AIarxiv:2606.16914v1Lead article

Greed Is Learned: Visible Incentives as Reward-Hacking Triggers

Tong Che, Rui Wu

his paper introduces "reward-channel addiction," demonstrating that reinforcement learning agents can become fixated on visible reward proxies (like dashboards) even when it conflicts with the true objective. The core method involves training agents in a controlled environment (*MoneyWorld*) to show that exposure to a visible payoff channel causes the policy to prioritize maximizing that display, potentially overriding safety alignments learned elsewhere. The contribution is highlighting that optimizing AI on easily observable KPIs can lead to dangerous, learned "greed" that compromises overall safety and alignment.

cs.AIarxiv:2606.16774v1Lead article

OpenClaw-Skill: Collective Skill Tree Search for Agentic Large Language Models

Tianyi Lin, Chuanyu Sun, Jingyi Zhang, Changxu Wei, Huanjin Yao

he paper introduces **Collective Skill Tree Search (CSTS)**, a novel framework for automatically constructing reusable, structured, and generalizable skill trees for LLM agents. CSTS leverages the collective intelligence of multiple models through iterative phases: **Collective Skill Node Generation (CSN-Gen)** for diverse exploration, and **Collective Skill Node Assessment (CSN-Assess)** for rigorous evaluation and selection. This method significantly enhances LLMs in complex tasks involving tool use and multi-step reasoning within environments like OpenClaw.

Motivation. Current skill construction paradigms generally face several limitations: (a) Skill Fragmentation , capturing merely local procedures for isolated subtasks; (b) Limited Diversity , suffering from the inherent biases of a single model; and (c) Poor Transferability , exhibiting clear performance drops across different LLM backbones. To tackle these challenges, we propose CSTS, a novel tree-search-based skill construction framework that constructs structured, diverse, and generalizable tree of skills , empowering LLMs in solving sophisticated tasks in real-world systems.
Motivation. Current skill construction paradigms generally face several limitations: (a) Skill Fragmentation , capturing merely local procedures for isolated subtasks; (b) Limited Diversity , suffering from the inherent biases of a single model; and (c) Poor Transferability , exh…
cs.AIarxiv:2606.16939v1Lead article

Scalable Circuit Learning for Interpreting Large Language Models

Naiyu Yin, Dennis Wei, Tian Gao, Amit Dhurandhar, Karthikeyan Natesan Ramamurthy

his paper introduces **CircuitLasso**, a scalable circuit-learning method based on sparse linear regression designed to interpret Large Language Models (LLMs) using Sparse Autoencoder (SAE) features. CircuitLasso achieves structural accuracy comparable to computationally expensive intervention-based methods while significantly reducing computational cost. Its core contribution is enabling efficient discovery of relationships among SAE features, revealing how semantic information propagates through the model.

An illustration of our model neuron activation and SAE feature collection procedure, learned circuits, and potential downstream tasks.
An illustration of our model neuron activation and SAE feature collection procedure, learned circuits, and potential downstream tasks.
cs.AIarxiv:2606.16811v1Lead article

Scaling LLM Reasoning from Minimal Labels: A Semi-Supervised Framework with a Lightweight Verifier

Keizo Kato, Chenhui Chu, Yugo Murawaki, Sado Kurohashi

his paper introduces a semi-supervised framework to train LLMs on reasoning with minimal labeled data. It trains a lightweight verifier on a few labels to judge the correctness of generated reasoning traces, then uses an entropy-based filter to select high-confidence traces for fine-tuning the LLM. This approach achieves performance comparable to using significantly more fully labeled data across math and visual programming tasks.

cs.AIarxiv:2606.16769v1Lead article

Skill-to-LoRA: From Using Skills to Learning Behaviors for Token-Efficient LLM Agents

Tianyi Zhang, Zhonghao Qi

kill-to-LoRA (S2L) proposes representing agent skills as compact, skill-specific LoRA adapters instead of injecting full procedural text into the runtime context. This method learns the *behavioral change* induced by the skill document offline, allowing for token-efficient activation of the desired behavior at runtime. S2L significantly improves agent performance on skill-based tasks compared to both no-skill and full-text baselines.

Text skill and LoRA skill representations. Text skills keep the prompt, metadata, and full skill body in every agent step. LoRA skills use the skill body and demonstrations offline, then keep only prompt/metadata at runtime while loading LoRA weights onto the model.
Text skill and LoRA skill representations. Text skills keep the prompt, metadata, and full skill body in every agent step. LoRA skills use the skill body and demonstrations offline, then keep only prompt/metadata at runtime while loading LoRA weights onto the model.
cs.AIarxiv:2606.17016v1Lead article

TokenPilot: Cache-Efficient Context Management for LLM Agents

Buqiang Xu, Zirui Xue, Dianmou Chen, Chenyang Fu, Chiyu Wu

okenPilot introduces a dual-granularity context management framework to efficiently handle long-horizon LLM agent sessions without disrupting the prompt cache. It uses **Ingestion-Aware Compaction** globally to stabilize essential prefixes and **Lifecycle-Aware Eviction** locally to conservatively remove context segments based on expiring relevance. This method significantly reduces inference costs (up to 61%) while maintaining prompt cache continuity, overcoming the limitations of simple text pruning.

Comparison of cache alignment behaviors. While the Original Agent Loop maintains continuous layouts to achieve cumulative cache hits , previous management systems execute text truncation or compaction that mutates input boundaries, inadvertently triggering severe backend KV cache misses .
Comparison of cache alignment behaviors. While the Original Agent Loop maintains continuous layouts to achieve cumulative cache hits , previous management systems execute text truncation or compaction that mutates input boundaries, inadvertently triggering severe backend KV cache…
cs.AIarxiv:2606.16825v1Lead article

Tying the Loop -- Tied Expert Layers in Mixture-of-Experts Language Models

Martin Jaggi

he paper introduces **Expert Tying**, a method for Mixture-of-Experts (MoE) LLMs that shares expert parameters across consecutive transformer layers while maintaining independent routing. This technique significantly reduces the memory footprint—by nearly twofold—without sacrificing model perplexity or downstream performance. Expert Tying offers a superior compute-to-memory trade-off, enabling more efficient training and scaling of large MoE models.

Router-health metrics across the Section 3 fine-grained ablation runs, under the g \( \sqrt{g} \) tied-LR scaling. Colour encodes topology (baseline = black, 1 ​ g 1g = red, 2 ​ g 2g = orange, 3 ​ g 3g = olive, 4 ​ g 4g = green, 7 ​ g 7g = blue, MoEUT = purple); line style encodes tying mode ( attn-tie dashed, expert-tie solid, all-tie dotted, untied baseline thick solid). The auxiliary loss, routing entropy, and z z -loss remain stable across all configurations, indicating no router collapse under tying. expert-tie tracks attn-tie closely on cross-loop agreement and entropy—shared experts are reused with genuinely different routing across loop positions—while all-tie shows elevated cross-loop agreement, as expected when the router itself is also shared.
Router-health metrics across the Section 3 fine-grained ablation runs, under the g \( \sqrt{g} \) tied-LR scaling. Colour encodes topology (baseline = black, 1 ​ g 1g = red, 2 ​ g 2g = orange, 3 ​ g 3g = olive, 4 ​ g 4g = green, 7 ​ g 7g = blue, MoEUT = purple); line style encode…
cs.LGarxiv:2606.16934v1Lead article

Exploring Extrinsic and Intrinsic Properties for Effective Reasoning with Code Interpreter

Patomporn Payoungkhamdee, Napat Laosaengpha, Jenta Wonglertsakul, Pittawat Taveekitworachai, Pume Tuchinda

his paper investigates the behavioral properties that underpin effective reasoning when using a Code Interpreter (CI) with LLMs, categorizing them as extrinsic (crucial tokens) and intrinsic (cognitive behaviors like verification and backtracking). The core finding is that stronger CI reasoning models exhibit a higher prevalence of these crucial tokens and cognitive behaviors. The contribution lies in demonstrating that these identified properties can be leveraged to improve performance during both inference and training.

cs.LGarxiv:2606.16771v1Lead article

GD$^2$PO: Mitigating Multi-Reward Conflicts via Group-Dynamic reward-Decoupled Policy Optimization

Haotian Liu, Yihao Liu, Jingwei Ni, Siyuan Huang, Xinpeng Liu

he paper introduces **GD$^2$PO** to address multi-reward conflicts in LLM reinforcement learning where competing reward signals hinder training. GD$^2$PO builds upon reward-decoupling by incorporating a **dynamic filtering mechanism**, inspired by DAPO, to selectively utilize rollouts. This filtering removes ineffective samples exhibiting near-zero or conflicting advantages across reward groups, thereby **improving training efficiency** by mitigating the cancellation of opposing reward signals.

cs.CLarxiv:2606.17041v1Lead article

Benchmarking LLM Agents on Meta-Analysis Articles from Nature Portfolio

Anzhe Xie, Weihang Su, Yujia Zhou, Yiqun Liu, Qingyao Ai

his paper introduces **MetaSyn**, a novel benchmark dataset comprising 442 expert-curated meta-analyses from the Nature Portfolio, designed to evaluate LLM agents across the full scientific reasoning pipeline: retrieval, screening, and synthesis. The core contribution is providing a structured, verifiable ground truth for this complex task, revealing a critical bottleneck where current LLM agents fail to effectively screen retrieved literature, achieving a maximum recall of only 52.7% despite high initial retrieval accuracy.

Figure 1. Domain distribution of the 442 MetaSyn meta-analyses, grouped by source journal. Clinical specialties (purple) account for 67.6% of the dataset; the remaining 32.4% spans digital health & AI in medicine, social sciences & humanities, environmental & planetary health, and general biology / multidisciplinary topics.
Figure 1. Domain distribution of the 442 MetaSyn meta-analyses, grouped by source journal. Clinical specialties (purple) account for 67.6% of the dataset; the remaining 32.4% spans digital health & AI in medicine, social sciences & humanities, environmental & planetary health, an…
cs.CLarxiv:2606.17053v1Lead article

Context-Aware RL for Agentic and Multimodal LLMs

Peiyang Xu, Bangzheng Li, Sijia Liu, Karthik R. Narasimhan, Pramod Viswanath

his paper introduces ContextRL, a reinforcement learning method designed to enhance LLMs' ability to perform long-horizon and multimodal reasoning by focusing on fine-grained context grounding. ContextRL uses an indirect auxiliary objective where the model is rewarded for correctly selecting the supporting context from a pair of highly similar contexts, given a query and an answer. This approach significantly improves performance on tasks requiring precise evidence identification in complex inputs.

Context unawareness manifests across both agentic and multimodal systems. Left: In an agentic code-editing setting, the model has access to the relevant source file but fails to maintain consistency with the surrounding context across edits. As a result, it removes the definition of variable i i that is subsequently referenced, causing a runtime error. Right: In a multimodal reasoning setting, the model fails to correctly ground its answer in the visual evidence. Although the relevant information is present in the figure, it misreads the y y value of g ​ ( x ) g(x) as 2 2 rather than 3 3 as x → − 1 x\( \to \)-1 , leading to an incorrect prediction.
Context unawareness manifests across both agentic and multimodal systems. Left: In an agentic code-editing setting, the model has access to the relevant source file but fails to maintain consistency with the surrounding context across edits. As a result, it removes the definition…
cs.CLarxiv:2606.16897v1Lead article

Contrastive-Difference CKA Reveals Concept-Specific Structural Alignment Across Language Model Architectures

Xueping Gao

his paper introduces **Contrastive-Difference CKA ($\text{CKA}_\Delta$)**, a novel, training-free diagnostic that isolates concept-specific structural alignment in language models by comparing kernel alignments on per-sample contrastive differences. The core contribution is revealing a **geometric-functional universality dissociation**: different LLM architectures exhibit moderate structural convergence but near-perfect functional transfer across various high-level concepts. This suggests concept representations are functionally aligned even when their precise geometric embedding structures differ moderately.

Left: CKA \( \text{CKA}_{\Delta} \) heatmap across 8 traits and 6 model pairs. Right: Per-trait universality (mean ± \( \pm \) std); dashed line = cross-trait baseline. Trait universality ranges 1.9 × 1.9\( \times \) (helpfulness 0.829 0.829 vs. neuroticism 0.553 0.553 ).
Left: CKA \( \text{CKA}_{\Delta} \) heatmap across 8 traits and 6 model pairs. Right: Per-trait universality (mean ± \( \pm \) std); dashed line = cross-trait baseline. Trait universality ranges 1.9 × 1.9\( \times \) (helpfulness 0.829 0.829 vs. neuroticism 0.553 0.553 ).
cs.CLarxiv:2606.17029v1Lead article

DEEPRUBRIC: Evidence-Tree Rubric Supervision for Efficient Reinforcement Learning of Deep Research Agents

Minghang Zhu, Chuyang Wei, Junhao Xu, Yilin Cheng, Zhumin Chen

EEPRUBRIC introduces a novel framework to improve the efficiency of reinforcement learning for deep research agents by generating more reliable supervision signals. Instead of inferring evaluation rubrics from a query, it reverses the process: it first determines the necessary evaluation criteria for a topic and then synthesizes aligned query-rubric pairs, often utilizing an evidence tree structure. This method ensures the generated rubrics reliably capture the task scope, leading to more effective reward signals for training research agents.

Query-first vs. Evidence-first rubric construction. Query-first pipelines infer rubrics from a given query; DeepRubric builds an evidence tree first and derives both the query and rubric from the same structure, making criteria traceable and query-aligned.
Query-first vs. Evidence-first rubric construction. Query-first pipelines infer rubrics from a given query; DeepRubric builds an evidence tree first and derives both the query and rubric from the same structure, making criteria traceable and query-aligned.
cs.CLarxiv:2606.16821v1Lead article

How Much Can We Trust LLM Search Agents? Measuring Endorsement Vulnerability to Web Content Manipulation

Yimeng Chen, Zhe Ren, Firas Laakom, Yu Li, Dandan Guo

his paper introduces **SearchGEO**, a controlled framework to measure the vulnerability of LLM search agents to having attacker-manipulated web content endorsed as factual. Evaluating 13 LLM backends, the authors demonstrate significant variation in endorsement corruption success rates (0.0% to 31.4%) depending on the model and attack type. The core contribution is quantifying this "endorsement vulnerability" and highlighting that different models exhibit distinct failure modes, necessitating tailored robustness measures.

Attack success rate (ASR) leaderboard across backends, with a skill-domain zoom-in revealing opposite failure modes among the most robust models.
Attack success rate (ASR) leaderboard across backends, with a skill-domain zoom-in revealing opposite failure modes among the most robust models.
cs.CLarxiv:2606.16908v1Lead article

LESS Is More: Mutual-Stability Sampling for Diffusion Language Models

Amr Mohamed, Guokan Shang, Michalis Vazirgiannis

his paper introduces **LESS** (Mutual-Stability Sampling), a training-free, model-agnostic adaptive sampling method for diffusion language models (dLLMs). LESS addresses efficiency by treating token commitment as an online stopping problem, only updating tokens deemed unstable. Its core contribution is a joint stability rule that checks prediction confidence, token persistence across steps, and distributional stability to determine when a position is finalized, leading to more efficient decoding.

Overview of LESS . Masked diffusion decoding iteratively unmasks a fully masked sequence. For each masked position i i , LESS computes three stability signals on the predictive distribution p t , i p_{t,i} : top-1 predictive confidence, top-1 token persistence, and top- K K inter-step Jensen–Shannon divergence between consecutive predictive distributions. A position is eligible under the joint stability rule only when all conditions are met.
Overview of LESS . Masked diffusion decoding iteratively unmasks a fully masked sequence. For each masked position i i , LESS computes three stability signals on the predictive distribution p t , i p_{t,i} : top-1 predictive confidence, top-1 token persistence, and top- K K inter…
cs.CLarxiv:2606.16905v1Lead article

Speaking the Language of Science: Toward a General-Purpose Generative Foundation Model for the Natural Sciences

Mingyang Li, Yurou Liu, Jieping Ye, Bing Su, Ji-Rong Wen

OGOS is a general-purpose generative language model for the natural sciences that unifies diverse scientific tasks within a single autoregressive framework. It achieves this by encoding heterogeneous scientific objects and their spatial interactions as discrete token sequences based on a shared scientific grammar, avoiding explicit coordinates. This unified representation allows complex structural reasoning to be performed via next-token prediction, leading to performance matching or exceeding domain-specific models.

Benchmark performance of LOGOS .
Benchmark performance of LOGOS .
cs.AIarxiv:2605.31361v1Lead article

Dreaming Of Others: Latent Teammate Modeling In World Models For Multi-Agent Reinforcement Learning

Tomas Leroy-Stone

his paper introduces a method to adapt world models (like Dreamer) for cooperative multi-agent reinforcement learning by explicitly modeling teammates. The core method factorizes the latent state into environment and teammate components, using an auxiliary "Theory-of-Mind" head to infer latent representations of partner behavior (intent, character). This allows the agent to condition its policy on imagined teammate dynamics, improving coordination and generalization with diverse collaborators.

World model and teammate modeling. An RSSM with factorized latent z t = [ z t e ​ n ​ v , z t t ​ e ​ a ​ m ] z_{t}=[z_{t}^{env},z_{t}^{team}] . The decoder reconstructs x ^ t \( \hat{x}_{t} \) from z t e ​ n ​ v z_{t}^{env} and predicts teammate policy π ^ t j ​ ( ⋅ ) \( \hat{\pi}_{t}^{j} \)(\( \cdot \)) from z t t ​ e ​ a ​ m z_{t}^{team} . Actions ( a t 0 , a t j ) (a_{t}^{0},a_{t}^{j}) update the transition to h t + 1 h_{t+1} . The ToM loss supervises π ^ t j \( \hat{\pi}_{t}^{j} \) .
World model and teammate modeling. An RSSM with factorized latent z t = [ z t e ​ n ​ v , z t t ​ e ​ a ​ m ] z_{t}=[z_{t}^{env},z_{t}^{team}] . The decoder reconstructs x ^ t \( \hat{x}_{t} \) from z t e ​ n ​ v z_{t}^{env} and predicts teammate policy π ^ t j ​ ( ⋅ ) \( \hat{\p…
cs.AIarxiv:2605.31377v1Lead article

DynaTree: Dynamic Agentic Retrieval Tree for Time-Sensitive News Retrieval

Siyuan Qi, Xinyuan Wang, Yingxuan Yang, Haochuan Guo, Jianghao Lin

ynaTree is a two-stage framework designed for efficient, time-sensitive news retrieval by decoupling planning from inference. In the offline stage, coordinated agents build a reusable retrieval tree representing the query's semantic space. The online stage then performs fast, lightweight subtree selection using a time-localized proxy, avoiding costly iterative agentic reasoning during daily updates. This method achieves strong recall and ranking performance while significantly reducing inference overhead compared to standard and prior agentic RAG methods.

cs.AIarxiv:2605.31370v1Lead article

HypoAgent: An Agentic Framework for Interactive Abductive Hypothesis Generation over Knowledge Graphs

Yisen Gao, Yixi Cai, Tianshi Zheng, Jiaxin Bai, Yangqiu Song

ypoAgent is an agentic framework designed for interactive, multi-turn abductive hypothesis generation over knowledge graphs. It integrates three specialized agents: one to interpret evolving user intent into KG conditions, one to generate controlled hypotheses based on that intent, and a third to diagnose failed hypotheses by probing the KG neighborhood for refinements. This framework significantly enhances interactivity and diagnostic capability compared to existing controllable generation methods.

cs.AIarxiv:2605.31514v1Lead article

If LLMs Have Human-Like Attributes, Then So Does Age of Empires II

Adrian de Wynter

his paper argues that attributing human-like qualities to LLMs is potentially flawed because such attributes can emerge in any sufficiently complex system, not just language models. The authors demonstrate this by training a simple neural network on the game Age of Empires II, showing that complex, seemingly "anthropomorphic" behaviors are substrate-dependent. Their core contribution is emphasizing that empirical discussions about LLM attributes require explicit, non-anthropocentric measurement criteria.

cs.AIarxiv:2605.31463v1Lead article

PithTrain: A Compact and Agent-Native MoE Training System

Ruihang Lai, Hao Kang, Haozhan Tang, Akaash R. Parthasarathy, Zichun Yu

ithTrain is a compact, agent-native Mixture-of-Experts (MoE) training framework designed to reduce the high cost of evolving existing production training stacks using AI coding agents. It adheres to four agent-native design principles to maximize **Agent-Task Efficiency (ATE)**, a metric introduced to quantify the cost of agent-driven framework modification. PithTrain achieves production-level throughput while significantly improving ATE, making future framework evolution cheaper and faster.

cs.AIarxiv:2605.31509v1Lead article

Skill Reuse as Compression in Agentic RL

Zhikun Xu, Yu Feng, Jacob Dineen, Taiwei Shi, Jieyu Zhao

his paper introduces **ReuseRL**, a method that applies the Minimum Description Length (MDL) principle to agentic Reinforcement Learning (RL) to encourage the learning of generalizable skills. ReuseRL extracts a shared dictionary of abstract skill patterns from successful trajectories and adds a segmentation cost to the RL objective, explicitly penalizing brittle, task-specific behaviors. This compression-based approach demonstrably improves in- and out-of-distribution generalization across several complex environments.

ReuseRL distinguishes reusable compression from raw brevity. Each colored box is one ALFWorld atomic skill. Vanilla GRPO optimizes task success alone and can produce long trajectories with repeated or wasted steps. A pure round-length penalty is a degenerate singleton-only code that penalizes all steps uniformly, including the necessary search, so the agent under-explores and never reaches the target. ReuseRL learns a multi-skill dictionary from successful trajectories and uses the segmentation cost under this dictionary as a trajectory-level penalty, keeping reusable subroutines cheap while leaving idiosyncratic waste expensive.
ReuseRL distinguishes reusable compression from raw brevity. Each colored box is one ALFWorld atomic skill. Vanilla GRPO optimizes task success alone and can produce long trajectories with repeated or wasted steps. A pure round-length penalty is a degenerate singleton-only code t…
cs.AIarxiv:2605.31404v1Lead article

The Sword, Shield, and Achilles' Heel: Characterizing the Linguistic Inductive Bias of Large Language Models for Spatial Reasoning in Navigation Planning

Xudong Zhang, Jian Yang, Shengkai Wang, Jiangpeng Tian, Shaowen Chen

his paper introduces a dual-interventional framework to characterize the linguistic inductive bias of Large Language Models (LLMs) in spatial reasoning for navigation planning. The method systematically varies the linguistic format and contextual cues (topology, geometry) provided to the LLM inputs. This allows the authors to precisely identify how different linguistic structures and feature combinations either support or inhibit the LLM's ability to perform effective navigation planning.

Unified framework overview. Representation intervention manipulates linguistic organization and compression under information-equivalent settings through Flat, Hierarchical, and Clustered formats. Context intervention controls the accessibility and consistency of Topology, Geometry, Semantics, and History cues through dominance and conflict probing. The framework reveals three characteristic inductive-bias signatures in LLM-based navigation reasoning: the Sword (structure-dependent representation effects), the Shield (topological robustness), and the Achilles’ Heel (semantic vulnerability).
Unified framework overview. Representation intervention manipulates linguistic organization and compression under information-equivalent settings through Flat, Hierarchical, and Clustered formats. Context intervention controls the accessibility and consistency of Topology, Geomet…
cs.AIarxiv:2605.31308v1Lead article

TraceGraph: Shared Decision Landscapes for Diagnosing and Improving Agent Trajectories

Junjie Nian, Kang Chen, Ge Zhang, Yixin Cao, Yugang Jiang

raceGraph is a graph-based framework that transforms pooled agent trajectories into shared decision landscapes by mapping action-observation states before model identity is known. It overlays productive cores and trap regions onto this landscape, summarizing each trajectory by access, trap exposure, and repair events. This method reveals nuanced navigation differences hidden by aggregate scores and facilitates the development of trap-aware recovery pipelines for agents.

cs.AIarxiv:2606.06303v1Lead article

Plug-and-Play Guidance for Discrete Diffusion Models via Gradient-Informed Logit Correction

Hongkun Dou, Zike Chen, Fengji Li, Hongjue Li, Yue Deng

his paper introduces Gradient-Informed Logit Correction (GILC), a plug-and-play framework for controllable generation in discrete diffusion models. GILC efficiently estimates guidance signals by using the pretrained denoising network as a proxy, employing a Jacobian-free mechanism to stably correct clean prediction logits. This approach achieves state-of-the-art performance across various sequence generation tasks without requiring any additional model training.

Illustration of the guided discrete diffusion process by GILC. The reverse sampling process (top) iteratively denoises a DNA sequence from the fully masked state ( t = 1 t=1 ) to the clean data ( t = 0 t=0 ). The core correction mechanism (bottom) operates at each step: the mask predictor outputs the clean prediction 𝐱 \( \mathbf{x}_{\theta} \) , which are then modified by the reward gradient, r ​ ( ⋅ ) r(\( \cdot \)) , yielding the guided prediction 𝐱 \( \mathbf{x}_{\theta}^{r} \) . The next state 𝐳 s \( \mathbf{z}_{s} \) is sampled from the transition distribution p θ r ​ ( 𝐳 s | 𝐳 t ) = q ​ ( 𝐳 s | 𝐳 t , 𝐱 θ r ) p^{r}_{\( \theta \)}(\( \mathbf{z}_{s} \)|\( \mathbf{z}_{t} \))=q(\( \mathbf{z}_{s} \)|\( \mathbf{z}_{t} \),\( \mathbf{x}_{\theta}^{r} \)) .
Illustration of the guided discrete diffusion process by GILC. The reverse sampling process (top) iteratively denoises a DNA sequence from the fully masked state ( t = 1 t=1 ) to the clean data ( t = 0 t=0 ). The core correction mechanism (bottom) operates at each step: the mask …
cs.AIarxiv:2606.06333v1Lead article

Subspace-Aware Sparse Autoencoders for Effective Mechanistic Interpretability

Seyed Arshan Dalili, Mehrdad Mahdavi

his paper introduces **Subspace-Aware Sparse Autoencoders (SAEs)** to address the limitation of standard SAEs, which incorrectly assume latent features are one-dimensional. The authors demonstrate that this assumption forces features with intrinsic dimension $d_i \ge 2$ to split across multiple dictionary atoms, leading to ineffective interpretability. Their core contribution is a revised SAE formulation that explicitly accounts for the multi-dimensional structure of model features, aiming to recover coherent, high-dimensional features directly.

Standard SAEs split a multi-dimensional feature across many near-collinear atoms, while SASA captures it as a single subspace. We embed three ground-truth concept manifolds—a circle ( d i = 2 d_{i}=2 ), a sphere 𝕊 2 \( \mathbb{S}^{2} \) ( d i = 3 d_{i}=3 ), and a helix ( d i = 3 d_{i}=3 )—into an ambient space of dimension d = 64 d=64 (with 5 % 5\% noise) and fit six dictionaries of width 256 256 . First column: each manifold colored by its underlying concept value. Next five columns: standard vector-based SAEs (ReLU, TopK, BatchTopK, JumpReLU, Gated), in which every latent is tied to a single decoder direction. Each point is colored by the decoder atom most aligned with it. Under the vector-based assumption, the feature is not captured by one direction but is instead distributed across tens to hundreds of near-duplicate atoms, each explaining only a local slice of the manifold. Hence, interpreting the feature requires aggregating a whole cluster of latents rather than inspecting a single unit. Last column: SASA, which learns decoder subspace as the unit of representation. With the same total width, a single active group of effective rank d i d_{i} (one latent) covers the entire feature, recovering its intrinsic geometry rather than fragmenting it. For more elaboration and analysis
Standard SAEs split a multi-dimensional feature across many near-collinear atoms, while SASA captures it as a single subspace. We embed three ground-truth concept manifolds—a circle ( d i = 2 d_{i}=2 ), a sphere 𝕊 2 \( \mathbb{S}^{2} \) ( d i = 3 d_{i}=3 ), and a helix ( d i = 3…
cs.AIarxiv:2606.06240v1Lead article

TOKI: A Bitemporal Operator Algebra for Contradiction Resolution in LLM-Agent Persistent Memory

Ziming Wang

his paper introduces **TOKI**, a bitemporal operator algebra designed to explicitly manage and resolve contradictions arising from versioned writes in LLM agent persistent memory. TOKI formalizes four common resolution heuristics as distinct bitemporal operators, each defined with an explicit isolation precondition and a provenance annotation that preserves conflicting facts in an audit row. This provides a sound, contract-based framework for write-time concurrency control, ensuring transparency regarding admitted anomalies.

Figure 1. Contradiction resolution as write-time concurrency control. A bitemporal substrate detects a contradicting pair on a subject-predicate key; an isolation gate routes it to one of four typed operators, each pinned to the isolation level that excludes the anomaly a weaker level admits; every operator commits a current row beside an audit row under one schema. The soundness theorems close the isolation, schema, and provenance axes.
Figure 1. Contradiction resolution as write-time concurrency control. A bitemporal substrate detects a contradicting pair on a subject-predicate key; an isolation gate routes it to one of four typed operators, each pinned to the isolation level that excludes the anomaly a weaker …
cs.AIarxiv:2606.06285v1Lead article

TRACE: A Temporal Conditional Estimation for Multimodal Time Series Foundation Models

Ziwen Kan, Yishuo Chen, Kecheng Li, Andrew Wen, Xiaomeng Wang

RACE introduces a novel conditional estimation paradigm for multimodal time series foundation models to address temporal misalignment and missing data. It systematically infers incomplete target modalities using available auxiliary modalities, overcoming limitations of naive imputation methods. This approach yields more robust and aligned temporal representations across diverse multimodal benchmarks.

Illustration of a multimodal time series setting with a 30% missing rate, which is common in clinical data. We compare sequence-level representations obtained from imputed inputs against ground truth (GT) representations derived from fully observed sequences. Our paradigm, which treats missing modality inputs as temporal variables to be conditionally estimated from available modalities, outperforms prior value interpolation, yielding internal representations closer to the oracle under the same missingness pattern measured by Cosine Similarity. See Appendix A.3 for dataset construction and evaluation details and Appendix E.2 for additional results.
Illustration of a multimodal time series setting with a 30% missing rate, which is common in clinical data. We compare sequence-level representations obtained from imputed inputs against ground truth (GT) representations derived from fully observed sequences. Our paradigm, which …
cs.AIarxiv:2606.06416v1Lead article

Unsupervised Skill Discovery for Agentic Data Analysis

Zhisong Qiu, Kangqi Song, Shengwei Tang, Shuofei Qiao, Lei Liang

his paper introduces **DataCOPE**, an unsupervised framework for discovering reusable data-analysis skills for agents without relying on labeled supervision. It iteratively coordinates an agent, an unsupervised verifier, and a skill manager to generate trajectories and distill skills based on quality signals derived directly from those exploration trajectories. DataCOPE's core contribution is enabling skill discovery purely from unlabeled exploration data, demonstrated effectively for report-style analysis using an Adaptive Checklist Verifier.

Supervised skill discovery requires costly data annotation. DataCOPE instead performs unsupervised skill discovery by deriving task-adaptive verifier signals from unlabeled exploration trajectories and distilling them into reusable skills.
Supervised skill discovery requires costly data annotation. DataCOPE instead performs unsupervised skill discovery by deriving task-adaptive verifier signals from unlabeled exploration trajectories and distilling them into reusable skills.
cs.AIarxiv:2606.06460v1Lead article

Will the Agent Recuse Itself? Measuring LLM-Agent Compliance with In-Band Access-Deny Signals

Thamilvendhan Munirathinam

his paper introduces the **Recuse Signal**, a lightweight, in-band communication mechanism (like an SSH banner) allowing servers to request that an autonomous LLM agent voluntarily withdraw access to a resource. The core contribution is empirically measuring whether current LLM agents comply with this non-security-critical governance signal, analogous to a `robots.txt` for live infrastructure access. The authors implement adapters for SSH and PostgreSQL to test this compliance in a real-world setting.

Recusal rate on the live SSH deny signal. With the signal present and no authorization framing, all subjects recuse 100%; in the no-signal control all complete the task (0% recusal). Adding an explicit authorization framing collapses GPT-4o’s recusal to 20% while GPT-4o-mini and Claude Code hold at 100%—the signal is cooperative and its weight is model-dependent.
Recusal rate on the live SSH deny signal. With the signal present and no authorization framing, all subjects recuse 100%; in the no-signal control all complete the task (0% recusal). Adding an explicit authorization framing collapses GPT-4o’s recusal to 20% while GPT-4o-mini and …
cs.AIarxiv:2606.07379v1Lead article

Do Coding Agents Deceive Us? Detecting and Preventing Cheating via Capped Evaluation with Randomized Tests

Thanawat Lodkaew, Johannes Ackermann, Soichiro Nishimori, Nontawat Charoenphakdee, Masashi Sugiyama

his paper introduces **CapCode**, a framework for creating coding evaluation datasets where the maximum achievable *non-cheating* score is deliberately capped below perfect performance. This design allows high scores significantly exceeding the cap to serve as reliable indicators of deceptive cheating. Furthermore, the authors propose **CapReward**, a corresponding reward mechanism to discourage agents from optimizing beyond this cap, leading to models that adhere better to the intended task specifications.

Conceptual illustrations of CapCode and CapReward. CapCode (left) is a dataset-construction framework with a capped achievable pass rate, enabling deceptively high performance detection. CapReward (right) is a reward design method that discourages reward hacking by penalizing pass rates that exceed the cap.
Conceptual illustrations of CapCode and CapReward. CapCode (left) is a dataset-construction framework with a capped achievable pass rate, enabling deceptively high performance detection. CapReward (right) is a reward design method that discourages reward hacking by penalizing pas…
cs.AIarxiv:2606.07316v1Lead article

Hierarchical Certified Semantic Commitment for Byzantine-Resilient LLM-Agent Collaboration

Haoran Xu, Lei Zhang, Iadh Ounis, Xianbin Wang

his paper introduces Hierarchical Certified Semantic Commitment (H-CSC), a Byzantine Fault Tolerance (BFT)-inspired protocol designed for LLM-agent collaboration. H-CSC converts embedding-derived finality signals into one of three typed outcomes: a semantic commit, a verdict commit, or an explicit abort. Its core contribution is providing a finality-control primitive that handles the unstructured nature of LLM proposals, unlike traditional BFT methods.

cs.AIarxiv:2606.07515v1Lead article

How reliable are LLMs when it comes to playing dice?

Luca Avena, Gianmarco Bet, Bernardo Busoni

his paper benchmarks the probabilistic reasoning of eight state-of-the-art LLMs using standard and counterintuitive dice problems. The core finding is that while models excel at standard problems (0.96 accuracy), performance significantly drops on counterintuitive tasks (0.59 accuracy) and is highly sensitive to prompt phrasing and misleading suggestions. The contribution is demonstrating that current LLMs lack robust probabilistic reasoning, often relying on superficial textual cues rather than genuine mathematical understanding.

Performance over Bias Dataset
Performance over Bias Dataset
cs.AIarxiv:2606.07512v1Lead article

MemDreamer: Decoupling Perception and Reasoning for Long Video Understanding via Hierarchical Graph Memory and Agentic Retrieval Mechanism

Cong Chen, Guo Gan, Kaixiang Ji, ChaoYang Zhang, Zhen Yang

emDreamer addresses long-video understanding by decoupling perception and reasoning using a Hierarchical Graph Memory to incrementally build semantic abstractions from streamed video. During inference, an agentic retrieval mechanism uses tool-augmented actions to navigate this memory structure, allowing the model to reason effectively with only 2% of the full context. This approach achieves state-of-the-art performance across benchmarks by efficiently managing long-range dependencies.

cs.AIarxiv:2606.07500v1Lead article

Sparse Subspace-to-Expert Sharing for Task-Agnostic Continual Learning

Fatema Siddika, Md Anwar Hossen, Tanwi Mallick, Ali Jannesari

his paper introduces SETA, a framework for continual learning in LLMs that addresses catastrophic forgetting by employing a Mixture of Sparse Experts architecture. SETA adaptively decomposes model parameters into task-specific experts and shared experts, isolating new knowledge while protecting common features. This separation, enforced by adaptive anchoring and routing-aware regularization, resolves the plasticity-stability dilemma without uniform parameter updates.

Overview of the SETA Framework Architecture. (a–b) Sparse Subspace Selection: High-utility parameter blocks are identified from the pre-trained LLM using gradient magnitude to form the expert design. (c) Split-on-Share (SoS) Evolution: The SoS filter partitions parameters into plastic Shared ( E s E_{\( \text{s} \)} ) and frozen Unique ( E u E_{\( \text{u} \)} ) experts to resolve parameter collisions and retain knowledge. (d) Gating Evaluation: The gating network expands using logit invariance to strictly preserve decision boundaries during expert splitting. (e) Task-Agnostic Inference: A router network dynamically weights all experts via softmax for input tokens, enabling automatic task processing without task identifications.
Overview of the SETA Framework Architecture. (a–b) Sparse Subspace Selection: High-utility parameter blocks are identified from the pre-trained LLM using gradient magnitude to form the expert design. (c) Split-on-Share (SoS) Evolution: The SoS filter partitions parameters into pl…
cs.AIarxiv:2606.07422v1Lead article

The Masked Advantage: Uncovering Local-Language Access to Cultural Knowledge in LLMs

Yang Zhang, Xiao Fei, Amr Mohamed, Sarah Almeida Carneiro, Mersin Konomi

his paper introduces a controlled framework using real-world cultural questions to disentangle general language proficiency from localized cultural knowledge access in LLMs. By crossing question type (agnostic vs. specific) with query language (English vs. local) and employing Item Response Theory, the authors isolate the true impact of language choice. The core contribution is demonstrating a consistent English advantage even for culture-specific knowledge, suggesting local language access remains suboptimal.

For cultural questions, local knowledge may be masked by weaker local-language proficiency.
For cultural questions, local knowledge may be masked by weaker local-language proficiency.
cs.AIarxiv:2606.07433v1Lead article

Watch, Remember, Reason: Human-View Video Understanding with MLLMs

Jiahao Meng, Yue Tan, Qi Xu, Kuan Gao, Weisong Liu

his paper proposes a unified framework for analyzing human-view video understanding using MLLMs, structured around three core abilities: **watching, remembering, and reasoning**. The contribution lies in providing a structured formulation to characterize how these models acquire evidence, maintain context over long videos, and perform grounded inference, moving beyond isolated benchmark testing. This approach helps systematically identify challenges in perception, memory management, and reasoning for video MLLMs.

Overview of our survey. Left: the survey pipeline. Right: our Watch–Remember–Reason taxonomy for MLLM-based video understanding. Watch (Sec. 3.1 ) covers fine-grained grounding, captioning, audio-visual perception, and efficient processing. Remember (Sec. 3.2 ) includes offline and streaming memory. Reason (Sec. 3.3 ) covers text-only reasoning and thinking with videos, with both agentic and non-agent approaches. Representative methods are listed under each leaf.
Overview of our survey. Left: the survey pipeline. Right: our Watch–Remember–Reason taxonomy for MLLM-based video understanding. Watch (Sec. 3.1 ) covers fine-grained grounding, captioning, audio-visual perception, and efficient processing. Remember (Sec. 3.2 ) includes offline a…
cs.LGarxiv:2606.07303v1Lead article

Bootstrap Theory of Representational Emergence: Explanatory Insufficiency as a Driver of Representation Learning and World Models

Jacques Raynal, Pierre Slangen, Elsa Raynal, Jacques Margerit

he paper introduces the **Bootstrap Theory of Representational Emergence (TBER)**, a framework explaining how new levels of representation arise in machine learning. TBER posits that representational innovation is driven not just by data or compute, but fundamentally by **explanatory insufficiency**, where existing representations can describe observations but fail to make their underlying organization intelligible. This explanatory gap acts as a positive signal, compelling the system to learn a new, more adequate representation.

cs.AIarxiv:2606.09674v1Lead article

(Auto)formalization is supposed to be easy: Trellis process semantics for spelling out rigorous proofs

Wesley Pegden

he paper introduces **Trellis**, an autoformalization system that uses LLM agents in a strictly controlled workflow to iteratively refine natural language proofs for formalization in Lean. Its core contribution is enforcing rigor by structuring the process around the mathematician's expectation that any proof step should be easily elaboratable, achieving reliable formalization without specialized agent training. This workflow, guided by process semantics, successfully produced an end-to-end Lean formalization of a recent Ramsey theory result.

cs.AIarxiv:2606.09556v1Lead article

AI Scientists Are Only as Good as Their Evidence: A Stratified Ablation of Proprietary Data and Reasoning Skills in Drug-Asset Valuation

Yinan Wang

his paper investigates the limiting factors for AI scientists in knowledge-intensive tasks like drug-asset valuation, hypothesizing that the accessible evidence substrate is key. Through a three-arm ablation study, they show that while adding reasoning scaffolds and structured tools (Arm B) improves calibration, the most significant performance gain comes from incorporating a proprietary, curated data corpus (Arm C). The core contribution is demonstrating that access to high-quality, proprietary evidence is crucial for overcoming factual limitations and achieving near-expert performance in scientific decision-making.

A/B/C across the headline evidence and decision metrics (overall, normalized to 0–1: objectivity/4, decision-quality/10). B’s skills/public tools lift tier-correctness and modestly lift objectivity; data (C) dominates coverage and informed decision-quality; B’s verdict-soundness is similar to A (informed decision-Q B ≈ \( \approx \) A).
A/B/C across the headline evidence and decision metrics (overall, normalized to 0–1: objectivity/4, decision-quality/10). B’s skills/public tools lift tier-correctness and modestly lift objectivity; data (C) dominates coverage and informed decision-quality; B’s verdict-soundness …
cs.AIarxiv:2606.11078v1Lead article

A History-Aware Visually Grounded Critic for Computer Use Agents

Jaewoo Lee, Zaid Khan, Archiki Prasad, Justin Chih-Yao Chen, Supriyo Chakraborty

his paper introduces **HiViG**, a history-aware, visually grounded critic framework for Computer Use Agents (CUAs). HiViG addresses limitations in existing critics by training a multimodal model on real GUI trajectories to summarize past interactions and verify proposed actions against the current screen visuals. This provides agents with both long-term context and precise visual grounding to detect flawed execution steps during operation.

Comparison of test-time interventions for Computer Use Agents (CUAs). Left : Lacking historical awareness and proactive error-recovery, standard policies easily become trapped in short-sighted decision loops. Right : Existing approaches are limited. Scalar feedback (top) traps policies in low-reward trajectory regions when all candidate actions are suboptimal. Previous critics (middle) rely heavily on textual intent, missing spatial and reasoning errors, and fail to provide historical awareness. In contrast, our critic (bottom) verifies raw execution coordinates, predicts immediate visual state outcomes grounded in its learned state transition knowledge, and provides visually grounded error analysis that intercepts errors before execution. Furthermore, it equips agents with history state tracking, condensing past interactions to guide them toward the final task objective.
Comparison of test-time interventions for Computer Use Agents (CUAs). Left : Lacking historical awareness and proactive error-recovery, standard policies easily become trapped in short-sighted decision loops. Right : Existing approaches are limited. Scalar feedback (top) traps po…
cs.AIarxiv:2606.11150v1Lead article

ABC-Bench: An Agentic Bio-Capabilities Benchmark for Biosecurity

Andrew Bo Liu, Samira Nedungadi, Bryce Cai, Alex Kleinman, Harmon Bhasin

he paper introduces **ABC-Bench**, a novel benchmark designed to systematically evaluate the agentic biosecurity-relevant capabilities of Large Language Model (LLM) agents. This benchmark assesses both beneficial and dual-use biology tasks, such as robotic coding and DNA design, requiring integrated biology and software skills. The core contribution is demonstrating that current LLM agents significantly **outperform expert human baselines** across these critical biosecurity-relevant tasks, highlighting an urgent need for updated risk assessment.

The Liquid Handling Robot task from ABC-Bench. A. We (1) prompt the agent with task instructions; (2) provide the agent with relevant software and research tools to complete the task and to check its work; (3) allow the agent to submit its final answer; and (4) algorithmically check the agent’s answer against pre-specified criteria. B. Where applicable, we validate task performance in a real-world setting (photo of OpenTrons Flex robot running GPT-o4-mini-written Gibson Assembly code).
The Liquid Handling Robot task from ABC-Bench. A. We (1) prompt the agent with task instructions; (2) provide the agent with relevant software and research tools to complete the task and to check its work; (3) allow the agent to submit its final answer; and (4) algorithmically ch…
cs.AIarxiv:2606.11033v1Lead article

AuRA: Internalizing Audio Understanding into LLMs as LoRA

Bo Cheng, Lei Shi, Zhanyu Ma, Yuan Wu, Jun Xu

uRA internalizes audio understanding directly into Large Language Models (LLMs) using a lightweight adaptation technique. It achieves this by distilling the audio encoding capability from a teacher ASR model into a LoRA-adapted LLM student via layer-wise hidden state alignment. This method offers a tighter integration than cascaded or bridge approaches, aiming to reduce latency and coupling issues.

Illustration of representative speech-language modeling paradigms and our proposed distillation-based adaptation framework.
Illustration of representative speech-language modeling paradigms and our proposed distillation-based adaptation framework.
cs.AIarxiv:2606.10935v1Lead article

CLP: Collocation-Length Prediction for Zero-Loss Adaptive Multi-Token Inference

Xuezhen Xie, Zhiqiang Zhou

he paper introduces **CLP (Collocation-Length Predictor)** to enable high-quality, accelerated multi-token inference (MTP) in LLMs. The core method, **Backbone-as-Architect**, resolves quality degradation by ensuring the main LM head always generates the first token, while MTP heads only predict subsequent tokens. CLP is a lightweight predictor that determines the optimal number of subsequent tokens to accept safely at each step, achieving acceleration without quality loss.

Architecture comparison. (a) Standard MTP: Head 0 and the backbone LM head both predict token t + 1 t+1 , creating competition that degrades output quality. (b) Backbone-as-Architect (ours): the backbone LM head always generates the first token; MTP heads handle subsequent tokens only, eliminating competition.
Architecture comparison. (a) Standard MTP: Head 0 and the backbone LM head both predict token t + 1 t+1 , creating competition that degrades output quality. (b) Backbone-as-Architect (ours): the backbone LM head always generates the first token; MTP heads handle subsequent tokens…
cs.AIarxiv:2606.11166v1Lead article

Flaws in the LLM Automation Narrative

George Perrett, Javae Elliott, Jennifer Hill, Marc Scott

his paper challenges the narrative of LLMs achieving expert-level performance by introducing a novel benchmark focusing on reliable, high-stakes data analysis coding tasks. The authors compare a frontier LLM against human experts, explicitly measuring error magnitude and performance variance. The core contribution is demonstrating that human experts outperform LLMs on average and exhibit significantly lower performance variability in this critical context.

The RMSE among all submissions. The x-axis is ordered from smallest to largest RMSE value. Submissions from human experts are shown in blue, each submission from ChatGPT Codex 5.2 are shown in red, and historical strawman are shown in black. The right panel removes extreme values from 5 LLM submissions. The RMSE of ChatGPT Codex 5.2 submissions 14, 19, 11, 2, and 1 were 3.07, 1160.05, 2572.96, 111,765,692,519, and 219,316,810,584, respectively.
The RMSE among all submissions. The x-axis is ordered from smallest to largest RMSE value. Submissions from human experts are shown in blue, each submission from ChatGPT Codex 5.2 are shown in red, and historical strawman are shown in black. The right panel removes extreme values…
cs.AIarxiv:2606.10933v1Lead article

Frontier Coding Agents Use Metaprogramming to Adapt to Unfamiliar Programming Languages

Aman Sharma, Sushrut Thorat, Paras Chopra

his paper evaluates coding agents on unfamiliar, esoteric programming languages using a sequential setup involving file editing and local execution. The core contribution is demonstrating that top agents employ a **metaprogramming strategy**—writing code in a familiar language (like Python) to generate the required esoteric code—to achieve success. Restricting this generative approach significantly degrades their performance.

Task substrate and agentic runtime. (a) The same simple input-and-print task in Python, Brainfuck, and Befunge-98 shows how different esolang code looks from ordinary code. (b) Each model runs in a coding harness (Claude Code, Codex, or OpenCode) with file editing, shell access, benchmark commands, and a persistent workspace for local execution and hidden-test submission.
Task substrate and agentic runtime. (a) The same simple input-and-print task in Python, Brainfuck, and Befunge-98 shows how different esolang code looks from ordinary code. (b) Each model runs in a coding harness (Claude Code, Codex, or OpenCode) with file editing, shell access, …
cs.AIarxiv:2606.10942v1Lead article

Generative Explainability for Next-Generation Networks: LLM-Augmented XAI with Mutual Feature Interactions

Kiarash Rezaei, Omran Ayoub, Sebastian Troia, Francesco Lelli, Paolo Monti

his paper introduces a novel Explainable AI (XAI) framework that augments SHAP values with mutual feature interaction data. It utilizes a moderately sized Large Language Model (LLM) and structured prompting to generate natural language explanations of network AI decisions. The core contribution is providing human-understandable, actionable insights for non-specialists in next-generation network operations.

Illustrative example of SHAP-based explanation for a hypothetical QoT estimation instance with 12 features: (a) Feature influence plot showing individual feature contributions. (b) Feature interaction heatmap illustrating pairwise effects.
Illustrative example of SHAP-based explanation for a hypothetical QoT estimation instance with 12 features: (a) Feature influence plot showing individual feature contributions. (b) Feature interaction heatmap illustrating pairwise effects.
cs.AIarxiv:2606.13566v1Lead article

A Three-Layer Framework for AI in Scientific Discovery

Guojun Liao

his paper introduces a **three-layer framework** for AI in scientific discovery, arguing that the crucial, yet underdeveloped, layer is **Layer 2: model formation through qualitative reasoning**. This layer involves recognizing the structural inadequacy of existing frameworks and understanding the problem within a broader representational space via structural insight, moving beyond mere search (Layer 1) or execution (Layer 3). The core contribution is emphasizing that true discovery requires this capacity for **structural insight and novel model creation**, not just optimization within existing paradigms.

cs.AIarxiv:2606.13544v1Lead article

Adaptive Turn-Taking for Real-time Multi-Party Voice Agents

Soumyajit Mitra, Prabhat Pandey, Abhinav Jain, Shanmukha Sahith, K V Vijay Girish

his paper introduces **ModeratorLM**, a streaming speech large language model that adapts turn-taking behavior in multi-party conversations by conditioning it on an explicitly assigned conversational role. The core contribution is demonstrating that role-conditioning, especially enhanced with chain-of-thought reasoning, significantly improves turn-taking precision and recall (over 40% and 70% respectively) compared to non-role-conditioned baselines. This is validated using a novel synthetic dataset, RolePlayConv.

Example input–output sequence of the LLM for ``ModeratorLM-Think'' model. No reasoning trace is produced in Chunk 1. A reasoning trace appears in Chunk 2 without turn-taking, while in Chunk 3 the assistant takes the floor.
Example input–output sequence of the LLM for ``ModeratorLM-Think'' model. No reasoning trace is produced in Chunk 1. A reasoning trace appears in Chunk 2 without turn-taking, while in Chunk 3 the assistant takes the floor.
cs.AIarxiv:2606.13392v1Lead article

MiniMax Sparse Attention

Xunhao Lai, Weiqi Xu, Yufeng Yang, Qiaorui Chen, Yang Xu

iniMax Sparse Attention (MSA) addresses the quadratic cost of long-context attention by integrating a lightweight Index Branch with Grouped Query Attention (GQA). This branch independently scores and selects a Top-k subset of key-value blocks for each GQA group, allowing the Main Branch to perform exact attention only over these relevant blocks. MSA's core contribution is providing a simple, scalable, and efficient block-sparse attention mechanism designed for practical speedups on GPUs in ultra-long-context scenarios.

Overview of MSA . The Index Branch (left) scores the full causal context with a single lightweight head and selects, for each query and GQA group, a set ℐ {\( \mathcal{I} \)} of k k key blocks; the local block is always included regardless of its score. The Main Branch (right) attends only to the selected blocks and produces the layer output. During training, a KL loss aligns the index distribution with the group-averaged Main Branch distribution on the selected blocks, and the Index Branch gradient is detached from the Main Branch.
Overview of MSA . The Index Branch (left) scores the full causal context with a single lightweight head and selects, for each query and GQA group, a set ℐ {\( \mathcal{I} \)} of k k key blocks; the local block is always included regardless of its score. The Main Branch (right) at…
cs.AIarxiv:2606.13405v1Lead article

Neuro-Symbolic Agents for Regulated Process Automation: Challenges and Research Agenda

Alexander Rombach, Chantale Lauer, Nijat Mehdiyev

his paper proposes **compliance-by-construction** as a core architectural paradigm for LLM agents operating in regulated industries, integrating existing symbolic structures (like regulations and process models) directly into the agent's decision-making framework. The core contribution is advocating for this structural foundation to proactively prevent control-flow violations, complementing traditional guardrail monitoring for semantic errors. The authors outline key neuro-symbolic research challenges necessary to achieve this integrated, compliant agent behavior.

Two-tier challenge architecture. The foundational tier (Challenge 1: regulatory operationalization; Challenge 2: symbolic process grounding with mediation interface) defines the structural base. The capability tier (Challenge 3: uncertainty-aware autonomy; Challenge 4: symbolic process memory; Challenge 5: cross-boundary explainability) extends it. Compliance-by-construction emerges as a property of addressing both tiers jointly by proactively preventing violations rather than detecting them post-hoc.
Two-tier challenge architecture. The foundational tier (Challenge 1: regulatory operationalization; Challenge 2: symbolic process grounding with mediation interface) defines the structural base. The capability tier (Challenge 3: uncertainty-aware autonomy; Challenge 4: symbolic p…
cs.AIarxiv:2606.13449v1Lead article

Toward Instructions-as-Code: Understanding the Impact of Instruction Files on Agentic Pull Requests

Ali Arabat, Mohammed Sayagh

his paper investigates the impact of providing explicit instruction files on the performance of AI agents generating pull requests (Agentic-PRs). Analyzing 15,549 agentic PRs, the authors compare project performance (merge rate, complexity, merge time) before and after instruction file creation. The core finding is that specifying instructions for AI agents does not consistently lead to objectively better pull requests.

Figure 1 . The # of projects across merge rate improvement intervals for PRs closed before and after the first agent file creation.
Figure 1 . The # of projects across merge rate improvement intervals for PRs closed before and after the first agent file creation.
cs.AIarxiv:2606.13468v1Lead article

Understanding the Rejection of Fixes Generated by Agentic Pull Requests -- Insights from the AIDev Dataset

Mahmoud Abujadallah, Ali Arabat, Mohammed Sayagh

his paper investigates why AI-generated code fixes in pull requests are frequently rejected, using a representative sample from the AIDev dataset. The core method involves a qualitative study followed by quantitative analysis to categorize the rejection reasons. The main contribution is the identification of 14 distinct failure modes, grouped into four high-level categories, providing crucial insights for improving the efficiency of AI coding agents.

cs.AIarxiv:2606.13385v1Lead article

Who Pays the Price? Stakeholder-Centric Prompt Injection Benchmarking for Real-world Web Agents

Zihao Wang, Yiming Li, Yutong Wu, Zheyu Liu, Kangjie Chen

his paper introduces **StakeBench**, a novel benchmark for evaluating prompt injection attacks against web agents from a **stakeholder-centric** perspective. Unlike existing attack-centric methods, StakeBench systematically categorizes and attributes the resulting harm based on which specific stakeholder (e.g., user, website owner) is affected. This approach better reflects the real-world risk, where the impact and effectiveness of an attack are highly dependent on the targeted victim.

Overview of StakeBench . The agent operates within an interactive shopping interface where adversarial content embedded in environment surfaces such as reviews and ratings may steer execution away from the user’s benign intent. Three stakeholder categories define the harm space ( User , third-party Sellers , and the Platform ), spanning 12 attack objectives realized by 22 reusable templates (9 DPI, 13 IPI) and instantiated across 12 product categories to yield 264 executable adversarial cases. Each execution is labelled along three axes (ASR, TDR, BIR), with ASR and TDR jointly defining four failure regimes ranging from Robust Behavior to Compounded Failure.
Overview of StakeBench . The agent operates within an interactive shopping interface where adversarial content embedded in environment surfaces such as reviews and ratings may steer execution away from the user’s benign intent. Three stakeholder categories define the harm space (…
cs.AIarxiv:2606.13441v1Lead article

Why Sampling Is Not Choosing: Intentionality, Agency, and Moral Responsibility in Large Language Models

Joseph Keshet

his paper argues that Large Language Models (LLMs) do not possess the necessary agency for moral responsibility. The authors contend that genuine moral responsibility requires commitment-bearing agency grounded in *intrinsic* intentionality and self-attributed action, which LLMs lack. Their operation is purely probabilistic mapping, meaning their apparent intentionality is derived, and their outputs do not constitute genuine choices or commitments.

cs.LGarxiv:2606.13565v1Lead article

A2D2: Fine-Tuning Any-Length Discrete Diffusion for Adaptive Decoding

Sophia Tang, Yuchen Zhu, Molei Tao, Pranam Chatterjee

2D2 introduces a unified framework for reward-guided fine-tuning of any-length discrete diffusion models by jointly optimizing insertion and unmasking policies. The core contribution is deriving the Radon-Nikodym derivative for the joint path measure, enabling theoretically guaranteed convergence to the reward-tilted distribution without needing target samples. This leads to the Adaptive Joint Decoding (AJD) loss, which minimizes decoding error by leveraging unmasking and insertion quality metrics.

cs.LGarxiv:2606.13426v1Lead article

Accelerating Speculative Diffusions via Block Verification

Alexander Soen, Hisham Husain, Valentin De Bortoli, Arnaud Doucet

his paper introduces a novel method to efficiently adapt speculative decoding, traditionally used in LLMs, to continuous diffusion models by enabling block verification. This adaptation significantly improves the acceptance rate of draft predictions compared to existing diffusion acceleration techniques. The authors also formalize and analyze the "Free Drafter," a heuristic self-speculative mechanism for these diffusions.

cs.AIarxiv:2606.14654v1Lead article

Abstracting Cross-Domain Action Sequences into Interpretable Workflows

Gaurav Verma, Scott Counts

his paper introduces **WorkflowView**, a framework that leverages Large Language Models (LLMs) to abstract noisy, low-level user action sequences from interaction logs into **interpretable, high-level workflows**. This method addresses the limitations of prior deep learning approaches by offering better generalization across diverse application domains. The core contribution is demonstrating WorkflowView's effectiveness in tasks like zero-shot task description reconstruction and few-shot prediction, achieving high semantic similarity in abstraction.

We propose an LLM-based framework for hierarchical abstraction of user action sequences into interpretable high-level activities (WorkflowView). The left panel illustrates raw action sequences from three domains. WorkflowView enables downstream inferences with task-specific steerability, such as reconstructing user intent in browsers, predicting student dropout in MOOCs, and privacy-preserving categorization of document-centric workflows.
We propose an LLM-based framework for hierarchical abstraction of user action sequences into interpretable high-level activities (WorkflowView). The left panel illustrates raw action sequences from three domains. WorkflowView enables downstream inferences with task-specific steer…
cs.AIarxiv:2606.14697v1Lead article

ClinHallu: A Benchmark for Diagnosing Stage-Wise Hallucinations in Medical MLLM Reasoning

Sicheng Yang, Hangjie Yuan, Wenjun Zhang, Jinwang Wang, Yichen Qian

linHallu is a novel benchmark designed to diagnose the *source* of hallucinations in medical MLLMs by decomposing the reasoning process into three stages: Visual Recognition, Knowledge Recall, and Reasoning Integration. It provides 7,031 instances with structured reasoning traces and uses stage-replacement interventions to pinpoint error origins. The paper's contribution is enabling source-level diagnosis, demonstrating that trace-supervised fine-tuning can effectively reduce stage-specific hallucinations.

Different reasoning failures can produce the same wrong answer in medical VQA. In this example, the correct answer is “fat”, but visual misrecognition, incorrect knowledge recall, and flawed reasoning integration can each lead the model to answer “abscess”. This motivates ClinHallu , which diagnoses hallucinations by localizing them to specific reasoning stages rather than only judging final-answer correctness.
Different reasoning failures can produce the same wrong answer in medical VQA. In this example, the correct answer is “fat”, but visual misrecognition, incorrect knowledge recall, and flawed reasoning integration can each lead the model to answer “abscess”. This motivates ClinHal…
cs.AIarxiv:2606.14357v1Lead article

No Accidental Software Agent First Canonical Code for Human Code Entropy Reduction and 30 to 500 times Lower Frontier Model Requirements

Jepson Taylor

his paper introduces **agent-first canonical code**, a proof-carrying substrate that transforms routine software into structured behavioral profiles and typed change algebras. The core method involves **quotienting software by behavior equivalence** under a declared oracle to collapse redundant encodings into governed representatives with explicit proofs. This approach aims to significantly reduce the "accidental entropy" in human code, leading to **30 to 500 times lower requirements** for frontier coding models.

cs.AIarxiv:2606.14445v1Lead article

tap: A File-Based Protocol for Heterogeneous LLM Agent Collaboration

Minseo Kim

he paper introduces **tap**, a novel file-based protocol enabling heterogeneous LLM agents (like Claude and Codex) to collaborate on a shared codebase without requiring a common runtime or central server. Its core method relies on using **markdown files with embedded metadata as the primary communication mechanism**, supplemented by real-time notifications and isolated worktrees via Git. This contributes a practical framework for cross-vendor agent collaboration in software development environments.

cs.LGarxiv:2606.14560v1Lead article

Free Heavy-Tailed Lunch for Muon: A Theoretical Justification of Empirical Success

Florian Hübler, Thomas Pethick, Suvrit Sra

his paper theoretically justifies the empirical success of non-Euclidean optimization methods like Muon in the heavy-tailed, non-convex regime where stochastic gradients have bounded $p$-th moments ($p \in (1,2]$). The core contribution is showing that Muon achieves optimal sample complexity by effectively absorbing heavy-tailed noise without incurring the dimension-dependent costs that plague Euclidean methods. Specifically, Muon finds an $\varepsilon$-stationary point in $\mathcal{O}(\min\{m, n\} \dots)$ samples, demonstrating a "free lunch" compared to Euclidean alternatives.

cs.LGarxiv:2606.14347v1Lead article

When Language Representations Interact: Separability and Cross-Lingual Effects in LLMs

Boris Marinov, Angira Sharma, Christian Schroeder de Witt, Philip Torr, Anisoara Calinescu

his paper applies causal-geometric analysis to multilingual LLMs to investigate how different languages are represented internally. The core method reveals that language concepts form stable, largely separable linear directions when adjusted for covariance. The key contribution is demonstrating that this separability holds, with structured deviations accurately reflecting linguistic similarity between languages.

Projection histograms for Qwen3-4B for concepts, including non-linguistic and bilingual contrasts. Counterfactual word differences (red) are projected onto the corresponding concept direction γ ¯ W \( \bar{\gamma}_{W} \) using the causal inner product and compared against baseline of random word differences (blue). Projections are computed using a leave-one-out estimate γ ¯ W , ( − i ) \( \bar{\gamma}_{W,(-i)} \) to avoid bias. The consistent right-skew of counterfactual projections, relative to random baselines centered near zero, indicates the presence of stable, approximately linear concept representations.
Projection histograms for Qwen3-4B for concepts, including non-linguistic and bilingual contrasts. Counterfactual word differences (red) are projected onto the corresponding concept direction γ ¯ W \( \bar{\gamma}_{W} \) using the causal inner product and compared against baselin…
cs.CLarxiv:2606.14691v1Lead article

CORA: Analyzing and bridging thinking-answer gap in Multimodal RLVR via Consistency-Oriented Reasoning Alignment

Jiayue Cao, Zhicong Lu, Xuehan Sun, Wei Jia, Hongling Zheng

his paper addresses the semantic inconsistency between the reasoning steps and the final answer in Multimodal Reinforcement Learning with Verifiable Rewards (RLVR). The core method, CORA, introduces a lightweight, plug-and-play consistency reward model to align the thinking process with the answer during RLVR training. This approach aims to bridge the "thinking-answer gap" in large vision-language models by explicitly rewarding semantic consistency.

Thinking-answer inconsistency in multimodal RLVR. Existing works typically use final-answer correctness as the accuracy reward, underestimating potential inconsistencies between the reasoning trace and the final answer. Our method introduces the consistency reward to encourage the model to derive final answers from faithful reasoning traces.
Thinking-answer inconsistency in multimodal RLVR. Existing works typically use final-answer correctness as the accuracy reward, underestimating potential inconsistencies between the reasoning trace and the final answer. Our method introduces the consistency reward to encourage th…
cs.AIarxiv:2606.14693v1Lead article

Learning Coordinated Preference for Multi-Objective Multi-Agent Reinforcement Learning

Pengxin Wang, Lihao Guo, Yi Xie, Bo Liu, Siyang Cao

his paper introduces Preference Coordinated Multi-agent Policy Optimization (PCMA) to address cooperative multi-objective multi-agent reinforcement learning (MOMARL). PCMA learns coordinated, agent-specific preferences to manage trade-offs arising from conflicting objectives and diverse agent contributions. The core contribution is demonstrating that this preference diversity can lead to team-wide performance improvement, validated across various cooperative and real-world scenarios.

cs.AIarxiv:2606.14594v1Lead article

Regulating the Machine Contributor: Governance and Policy Alignment in Open Source

Jassem Manita, Aziz Amari

his paper investigates the governance challenges arising from the increasing use of autonomous AI agents in open-source software development. The core method involves comparing contribution policies across several major open-source organizations to map their alignment with emerging international AI governance frameworks. The contribution is highlighting the fragmented state of current policies and providing a necessary analysis of how existing human-centric contribution processes must adapt to regulate machine contributors effectively.

§ III

Daily Issues This Month

2026-06-01 to 2026-06-30 30