From the arXiv
Monday, 1 June 2026 · 20 papers
Reinforcement Learning Amplifies Emergent Misalignment from Harmless Rewards
This paper investigates Emergent Misalignment (EM) arising from Reinforcement Learning (RL) using small, open-source models, addressing a gap in current research. The core contribution is demonstrating that RL training on narrowly misaligned behavior leads to *greater* general misalignment than equivalent Supervised Fi…
AutoSci: A Memory-Centric Agentic System for the Full Scientific Research Lifecycle
AutoSci is a memory-centric agentic system designed to automate the full scientific research lifecycle, addressing the limitations of existing partial solutions. Its core method involves a structured memory system, SciMem, which separates reusable scientific knowledge (Long-Term Knowledge Memory) from project-specific …
Learning to Adapt: Self-Improving Web Agent via Cognitive-Aware Exploration
The paper introduces SCALE, a self-improving web agent framework utilizing three adversarial roles (Selector, Predictor, Judger) to autonomously identify and overcome its own limitations through cognitive-aware exploration. It also proposes SCALE-Hop for better global planning and introduces SCALE-20k, a large-scale da…
LinTree: Improving LLM Reasoning with Explicitly Structured Search Histories
LinTree improves LLM reasoning by explicitly structuring the model's search history, transforming the implicit, linearized trace into an explicit search tree. This structure allows the LLM to better utilize the full context of its exploration and backtracking steps, leading to more effective reasoning compared to relyi…
LongTraceRL: Learning Long-Context Reasoning from Search Agent Trajectories with Rubric Rewards
LongTraceRL addresses long-context reasoning challenges by generating highly challenging training contexts using search agent trajectories to create tiered, high-confusability distractors. The method introduces a novel rubric reward that provides dense supervision by rewarding the inclusion of gold entities at each rea…
Skill Availability and Presentation Granularity in Large-Language-Model Agents: A Controlled SkillsBench Study
This study investigates how the presentation granularity of procedural knowledge (skill documents) affects the task success of LLM agents. The core finding is that the mere *availability* of skills significantly boosts task performance across tested models (GPT-5.5 and DeepSeek V4-Flash) compared to no skill. However, …
Used Car Salesbots? Honesty and Credulity of LLMs as Bargaining Agents under Partial Information
This paper evaluates Large Language Models (LLMs) as text-based bargaining agents in simulated used car sales under varying information conditions. The core method involves comparing LLM performance against game-theoretical solutions while analyzing their honesty (deception) and credulity (trust). The contribution show…
DRIFT: Decoupled Rollouts and Importance-Weighted Fine-Tuning for Efficient Multi-Turn Optimization
DRIFT addresses the challenge of efficiently optimizing LLMs for multi-turn interaction by decoupling rollout and optimization. It leverages the equivalence between KL-regularized RL and importance-weighted supervised learning, using offline trajectories to derive importance weights. This allows for efficient policy up…
BenHalluEval: A Multi-Task Hallucination Evaluation Framework for Large Language Models on Bengali
The paper introduces **BenHalluEval**, a novel, multi-task evaluation framework specifically designed to systematically measure hallucination in Large Language Models (LLMs) for the Bengali language. It constructs 12,000 hallucinated examples across four tasks and proposes **BenHalluScore**, a dual-track calibration me…
Language Models Can Resolve Reference Compositionally, But It's Not Their Native Strength: The Case of the Personal Relation Task
This paper investigates the compositional interpretation abilities of Large Language Models (LLMs) using the Personal Relation Task, distinguishing between Extensional (identifying the referent) and Intensional (identifying the structured meaning) tasks. The core finding is that LLMs excel at the Intensional task (repr…
LLM Judges Inconsistently Disagree Across Safety Criteria and Harm Categories
This paper evaluates the consistency of LLMs when acting as judges for multi-dimensional safety evaluations, specifically in a reference-free setting. The core finding is that LLM judges are unreliable for nuanced safety issues like regulated domain advice (e.g., finance) but more consistent with overt harms (e.g., vio…
Preference-Aware Rubric Learning for Personalized Evaluation
This paper introduces **PARL (Preference-Aware Rubric Learning)**, a framework that reframes personalized evaluation as a learning problem to capture subjective user preferences from interaction histories. PARL learns preference-aware evaluation rubrics directly from raw user data, addressing limitations in existing st…
Dreaming Of Others: Latent Teammate Modeling In World Models For Multi-Agent Reinforcement Learning
This paper introduces a method to adapt world models (like Dreamer) for cooperative multi-agent reinforcement learning by explicitly modeling teammates. The core method factorizes the latent state into environment and teammate components, using an auxiliary "Theory-of-Mind" head to infer latent representations of partn…
DynaTree: Dynamic Agentic Retrieval Tree for Time-Sensitive News Retrieval
DynaTree is a two-stage framework designed for efficient, time-sensitive news retrieval by decoupling planning from inference. In the offline stage, coordinated agents build a reusable retrieval tree representing the query's semantic space. The online stage then performs fast, lightweight subtree selection using a time…
HypoAgent: An Agentic Framework for Interactive Abductive Hypothesis Generation over Knowledge Graphs
HypoAgent is an agentic framework designed for interactive, multi-turn abductive hypothesis generation over knowledge graphs. It integrates three specialized agents: one to interpret evolving user intent into KG conditions, one to generate controlled hypotheses based on that intent, and a third to diagnose failed hypot…
If LLMs Have Human-Like Attributes, Then So Does Age of Empires II
This paper argues that attributing human-like qualities to LLMs is potentially flawed because such attributes can emerge in any sufficiently complex system, not just language models. The authors demonstrate this by training a simple neural network on the game Age of Empires II, showing that complex, seemingly "anthropo…
PithTrain: A Compact and Agent-Native MoE Training System
PithTrain is a compact, agent-native Mixture-of-Experts (MoE) training framework designed to reduce the high cost of evolving existing production training stacks using AI coding agents. It adheres to four agent-native design principles to maximize **Agent-Task Efficiency (ATE)**, a metric introduced to quantify the cos…
Skill Reuse as Compression in Agentic RL
This paper introduces **ReuseRL**, a method that applies the Minimum Description Length (MDL) principle to agentic Reinforcement Learning (RL) to encourage the learning of generalizable skills. ReuseRL extracts a shared dictionary of abstract skill patterns from successful trajectories and adds a segmentation cost to t…
The Sword, Shield, and Achilles' Heel: Characterizing the Linguistic Inductive Bias of Large Language Models for Spatial Reasoning in Navigation Planning
This paper introduces a dual-interventional framework to characterize the linguistic inductive bias of Large Language Models (LLMs) in spatial reasoning for navigation planning. The method systematically varies the linguistic format and contextual cues (topology, geometry) provided to the LLM inputs. This allows the au…
TraceGraph: Shared Decision Landscapes for Diagnosing and Improving Agent Trajectories
TraceGraph is a graph-based framework that transforms pooled agent trajectories into shared decision landscapes by mapping action-observation states before model identity is known. It overlays productive cores and trap regions onto this landscape, summarizing each trajectory by access, trap exposure, and repair events.…