arXiv:2602.21556v2 Announce Type: replace
Abstract: When designing compound AI systems, a common approach is to query multiple copies of the same model and aggregate the responses to produce a synthesized output. Given the homogeneity of these models, this raises the question of whether aggregation unlocks access to a greater set of outputs than querying a single model. In this work, we investigate the power and limitations of aggregation within a stylized principal-agent framework. This framework models how the system designer can partially steer each agent's output through its reward function specification, but still faces limitations due to prompt engineering ability and model capabilities. Our analysis uncovers three natural mechanisms -- feasibility expansion, support expansion, and binding set contraction -- through which aggregation expands the set of outputs that are elicitable by the system designer. We prove that any aggregation operation must implement one of these mechanisms in order to be elicitability-expanding, and that strengthened versions of these mechanisms provide necessary and sufficient conditions that fully characterize elicitability-expansion. Finally, we provide an empirical illustration of our findings for LLMs deployed in a toy reference-generation task. Altogether, our results take a step towards characterizing when compound AI systems can overcome limitations in model capabilities and in prompt engineering.
Science Journals
arXiv:2603.16074v2 Announce Type: replace
Abstract: Non-strict control barrier function (CBF) conditions guarantee safety through forward invariance, but they do not preclude trajectories from remaining near the safe-set boundary for extended continuous time intervals. This paper develops a finite boundary-layer residence certificate for such settings. The certificate preserves the standard non-strict CBF safety condition and uses a bounded auxiliary function whose derivative is bounded away from zero in a prescribed boundary layer, yielding an explicit upper bound on every uninterrupted residence interval. For control-affine systems, a selected auxiliary branch is implemented as an additional affine constraint in a CBF-QP, and a tangential-input compatibility condition is given to ensure simultaneous feasibility with the hard CBF constraint for unconstrained inputs. A local-chart version handles angular or multi-valued auxiliary functions such as $\operatorname{atan2}$. Single-integrator, double-integrator, and nonholonomic unicycle examples illustrate the resulting radial--tangential construction and its local-chart and feasibility limitations.
arXiv:2602.23128v2 Announce Type: replace
Abstract: Generalization bounds for deep learning models are typically vacuous, not computable or restricted to specific model classes. In this paper, we tackle these issues by providing new disagreement-based certificates for the gap between the true risk of any two predictors. We then bound the true risk of the predictor of interest via a surrogate model that enjoys tight generalization guarantees, and by evaluating our disagreement bound on an unlabeled dataset.We empirically demonstrate the tightness of the obtained certificates and showcase the versatility of the approach by training surrogate models leveraging three different frameworks: sample compression, model compression and PAC-Bayes theory. Importantly, such guarantees are achieved without modifying the target model, nor adapting the training procedure to the generalization framework.
arXiv:2607.07367v1 Announce Type: new
Abstract: Spherical range queries are a fundamental primitive for working with spatial data. Many spatial data structures have been developed to answer these queries, but choosing the optimal one for a specific application is a difficult task. This is because theoretical worst-case bounds are often overly pessimistic, and existing average-case analyses are rather restricted and hard to compare.
We address this problem with two main contributions. First, we present a comprehensive evaluation of state-of-the-art spatial indices across a diverse set of benchmarks. This includes a new benchmark based on graph embeddings alongside multiple real-world datasets from the literature. Our benchmark covers instances scaling up to 10M points and ranging between 2 and 960 dimensions.
Second, we introduce the Sorted-Projection Radius KD-tree (SPRK-tree), a high-performance KD-tree variant. The SPRK-tree combines aggressive subtree pruning via radius reduction, sorted projection-based leaf nodes, and careful implementation optimizations. It consistently achieves the fastest query times in almost all benchmarks, and ranks second in the few remaining cases.
arXiv:2605.29693v2 Announce Type: replace
Abstract: Urban traffic congestion is a growing global issue contributing significantly to long commute times and environmental pollution. Traditional traffic signal control systems often fail to adapt to dynamic traffic conditions. Adaptive traffic signal control can improve urban traffic without changing road infrastructure. Deep Reinforcement Learning (DRL) has shown strong performance for this task, but existing delay and queue-based rewards often produce short-sighted or unstable policies. This paper proposes a Momentum-Based Reward Function (MBRF) that encourages vehicles to keep moving rather than penalizing congestion alone. The method is evaluated in SUMO (Simulation of Urban MObility) using standard traffic metrics such as waiting time, queue length, throughput, and CO2 emissions. Results show that the proposed reward produces better throughput-emission trade-offs and more stable learning behavior than delay or queue-based rewards, as well as classical controllers such as Max Pressure and LQF.
arXiv:2607.06572v1 Announce Type: new
Abstract: In homogeneous magnetohydrodynamic (MHD) turbulence without a background magnetic field driven by mechanical forces, an exact decomposition of the energy fluxes (D. Capocci et al., Journal of Plasma Physics, 91(1), E11 (2025)) has shown that current-sheet thinning is the dominant physical mechanism responsible for transferring energy from large to small scales. In contrast, mechanisms that are characteristic of hydrodynamic turbulence, such as vortex stretching and strain self-amplification, are strongly suppressed. Here, we extend this analysis to MHD turbulence in the presence of weak and strong imposed magnetic field, as previously driven by mechanical forces, and confirm that current-sheet thinning remains the leading process driving the energy cascade toward smaller scales in these more realistic configurations, and find enhanced scale invariance in the subfluxes. In addition to that, a decomposition of the contributions from the fluctuating and the background magnetic field to the conversion between kinetic and magnetic energies shows that the background-field-dependent contribution results in a nonlinear dynamo, that is an effective kinetic-to-magnetic conversion at large and intermediate scales. However, at small scales, it has the opposite effect, resulting in a net conversion of magnetic to kinetic energy.
arXiv:2607.07654v1 Announce Type: cross
Abstract: The paper establishes extra invariant in magnetohydrodynamics (MHD) of rotating and stratified fluid layer. This invariant is conserved adiabatically, i.e. approximately over long time. The existence of the invariant is interesting by itself, as such invariants are extremely rare. However, in addition, this invariant appears to be connected to the famous dynamo phenomenon.
arXiv:2605.08332v2 Announce Type: replace-cross
Abstract: Feedback-based adaptive quantum optimization (FALQON) is a promising approach for solving combinatorial problems on noisy intermediate-scale quantum (NISQ) devices, requiring only single circuit evaluations per layer. However, standard FALQON relies on fixed hyperparameters that severely limit convergence speed, requiring hundreds to thousands of layers for acceptable solutions. This paper proposes Optimal FALQON, an optimization-based formulation that treats the per-layer time step ($\delta_k$) and scaling factor ($M_k$) as decision variables optimized via classical methods. We present a comprehensive empirical study on all 94 non-isomorphic 3-regular graphs with 12 vertices, comparing Optimal FALQON with standard FALQON and multiple QAOA variants. Results demonstrate statistically significant improvements in success probability, evaluation efficiency, and depth-normalized cost across the evaluated benchmarks. Furthermore, initializing QAOA with parameters from Optimal FALQON yields superior warm-start performance compared to fixed initialization.
arXiv:2607.06807v1 Announce Type: new
Abstract: While enabling effective collaboration on complex tasks, LLM-based Multi-Agent Systems (MAS) face critical security challenges due to vulnerabilities at the agent and interaction levels. Most existing MAS security defenses are built upon two core assumptions: semantically-explicit malicious attacks and explicit graph-based modeling of the MAS topology and agent-level interactions. In practice, real-world attacks are becoming more semantically stealthy, while MAS execution is typically asynchronous without the temporal alignment assumed by graph-based propagation models. To address these limitations, we propose AcMAS, an activation-based framework for malicious-behavior detection in MAS. By analyzing internal reasoning states in the activation space of local agents, AcMAS detects even stealthy attacks in a synchronization-robust fashion, without relying on explicit interaction graphs. Moreover, our activation analysis provides critical signals to guide AcMAS in restoring the functionality of compromised agents, rather than the disruptive agent isolation commonly used by the state-of-the-art methods. Comprehensive evaluation demonstrates that AcMAS significantly outperforms graph-based baselines against stealthy attacks, by +0.22 F1 in synchronous settings (0.94 vs. 0.72) and by +0.55 F1 in asynchronous settings (0.93 vs. 0.38), with generalization across diverse open-source LLM backbones, attack intensity, and MAS scale.
arXiv:2508.16601v5 Announce Type: replace-cross
Abstract: This paper unifies deterministic and stochastic Electromagnetic Information Theory (EIT) through symplectic geometry. For spatially incoherent sources, both formulations yield identical eigenvalues and spatial Number of Degrees of Freedom (NDF). In the asymptotic regime and in the absence of losses, this equivalence is shown to be a structural necessity: the radiometric \'etendue, the Hamiltonian phase-space volume, and the NDF are the same symplectic invariant of the source--observer configuration. Liouville's theorem guarantees conservation of the NDF under lossless propagation, while Gromov's Non-Squeezing Theorem establishes a minimum phase-space cell, setting a fundamental geometric bound on resolving power. The physical manifestation of this symplectic structure is the formation of \textit{Spatial Information Flows} (SIFs), defined operationally as the spatial loci along which the spatial coherence, equivalently the mutual information, decays at the minimum possible rate. Spatial information in electromagnetic fields is therefore governed by the geometry of the source--observer configuration, providing the foundation for a geometric theory of electromagnetic information.
arXiv:2607.06843v1 Announce Type: new
Abstract: Diffusion-based text-to-motion models synthesize realistic human motions but often exhibit semantic drift from the input text. Motion is inherently temporal, especially in compositional and long-duration sequences that require semantic consistency across multiple action segments and smooth kinematic transitions throughout the trajectory. We posit that the initial noise is central to this consistency: within the Gaussian noise space, certain instances, i.e. winning noise tickets, carry latent structure that biases denoising toward particular motion semantics, even under null prompts. We propose WInning Noise Retrieval and Optimization (WINRO), a training-free, model-agnostic framework that improves text-motion alignment by selecting and refining such tickets before diffusion sampling. WINRO maps random noises to motion features generated under null prompts, retrieves the best-aligned noise for a given text, and refines it via a KL-regularized objective that reduces the residual semantic gap while preserving the Gaussian prior. An optional LoRA-based adapter amortizes this refinement into a single forward pass. WINRO consistently improves text-motion fidelity across different base models, MDM and MotionLCM, on HumanML3D without retraining, improves temporal robustness on the MTT benchmark, and generalizes to applications such as motion stylization and spatial constraint satisfaction.
arXiv:2607.07447v1 Announce Type: new
Abstract: Wireless powered communication networks (WPCNs) are a key enabler for sustainable Internet of Things (IoT) systems, yet their practical performance is constrained by inefficient wireless energy transfer, limited spatial adaptability, and fragile uplink connectivity in blockage-prone and dynamic environments. Emerging reconfigurable antenna technologies, including pinching antenna systems (PASSs), fluid antenna systems (FASs), movable antennas (MAs), and reconfigurable intelligent surfaces (RISs), provide new opportunities to overcome these limitations, but have mostly been studied separately. In this article, we propose a unified architecture for fully reconfigurable WPCNs by jointly integrating PASS-enabled power beacons, FAS-based IoT devices, MA-assisted base stations, and RIS-aided propagation environments. The proposed framework enables end-to-end reconfigurability across downlink energy transfer, device-side spatial adaptation, base-station reception, and uplink information transmission. We further discuss the integration motivation, system architecture, design and optimization framework, illustrative performance evaluation, implementation tradeoffs, and major practical challenges. This article provides a new perspective for designing next-generation fully reconfigurable WPCNs.
arXiv:2601.00086v3 Announce Type: replace
Abstract: Large language models (LLMs) often struggle to use tools reliably in domain-specific settings, where APIs may be idiosyncratic, under-documented, or tailored to private workflows. This highlights the need for effective adaptation to task-specific tools. We propose RIMRULE, a neuro-symbolic approach for LLM adaptation based on dynamic rule injection. Compact, interpretable rules are distilled from failure traces and injected into the prompt during inference to improve task performance. These rules are proposed by the LLM itself and consolidated using a Minimum Description Length (MDL) objective that favors generality and conciseness. Each rule is stored in both natural language and a structured symbolic form, supporting efficient retrieval at inference time. Experiments on tool-use benchmarks show that this approach improves accuracy on both seen and unseen tools without modifying LLM weights. It outperforms prompting-based adaptation methods and complements finetuning. Moreover, rules learned from one LLM can be reused to improve others, including long reasoning LLMs, highlighting the portability of symbolic knowledge across architectures.
arXiv:2601.01159v2 Announce Type: replace
Abstract: Rigorous quantum dynamics calculations provide essential insights into complex scattering phenomena across atomic and molecular physics, chemical reaction dynamics, and astrochemistry. However, the application of the gold-standard quantum coupled-channel (CC) method has been fundamentally constrained by a steep cubic scaling of computational cost $[{O}(N^3)]$. Here, we develop a general, rigorous, and robust method for solving the time-independent Schr\"odinger equation for a single column of the scattering S-matrix with quadratic scaling $[{O}(N^2)]$ in the number of channels. The Weinberg-regularized Iterative Series Expansion (WISE) algorithm resolves the divergence issues affecting iterative techniques by applying a regularization procedure to the kernel of the multichannel Lippmann-Schwinger integral equation. The method also explicitly incorporates closed-channel effects, including those responsible for multichannel Feshbach resonances. We demonstrate the power of this approach by performing rigorous calculations on He + CO and CO + N$_2$ collisions, achieving exact quantum results with quadratic scaling guaranteed by a contour-integral construction. Our results establish a highly scalable computational paradigm, enabling state-to-state quantum scattering computations for complex molecular systems.
arXiv:2607.06621v1 Announce Type: new
Abstract: The pre-softmax score of an attention head is a bilinear form $score(i,j) = x_i^T M x_j$ in a learned operator $M = W_q^T W_k$. Because M is generally non-symmetric, hence non-normal, it has a complex eigenspectrum and non-orthogonal eigenvectors, the regime where non-Hermitian and random-matrix tools apply. We ask what this spectrum encodes, at three levels for previous-token and induction circuits. Statically, across seven pretrained models spanning three positional schemes, the strongest previous-token heads are spectrally rotational under RoPE and non-rotational, or content-like, where position enters outside QK (learned-absolute and ALiBi); the model-level separation is perfect at every top-k examined (exact permutation $p=0.029$), and zeroing the per-frequency RoPE phase $Im(M_t)$ eliminates induction on a pre-identified previous-token head in all three RoPE models. Dynamically, over public Pythia checkpoints every head originates at the random-matrix (Ginibre) null; the rotational signature emerges with the behavior, not before it, and the population-median suppression that yields the final profile follows circuit formation, so the profile is a consolidated fingerprint, not a precursor. Causally, and at toy scale, no spectral channel is necessary: constrained two-layer training reroutes around every ban with capability intact, albeit at a significant formation delay (four pre-registered contrasts, $q_BH <= 0.016$). The cost structure exposes each scheme's default: imposing symmetry slows learned-absolute models by a factor of 2.9, whereas a RoPE head with a fully symmetric static M still routes directionally via the phase channel, impossible under absolute positions. Within the settings examined, the positional scheme sets the default spectral algebra of an attention head's solution: a fingerprint sculpted after function, not a hard constraint upon it.
arXiv:2606.26306v2 Announce Type: replace
Abstract: Distributed acoustic emission (AE) sensing is critical for early detection of structural degradation, yet conventional electrical sensors are difficult to scale and fiber-based approaches are limited by interrogation complexity and resolution. Here, we report an intelligent fiber Bragg grating (FBG) sensing system enabled by machine learning (ML)-trained hybrid III-V/SiN tunable lasers that achieve uniform, mode-hop-free, sub-picometer wavelength control. A supervised gradient-descent algorithm is used to learn the nonlinear electro-thermal tuning space of Vernier-based external-cavity lasers, enabling continuous tuning with <0.1 pm resolution and <0.5 dB power variation. This capability allows precise alignment to FBG reflection slopes for high-sensitivity acoustic detection. We demonstrate a four-laser interrogation system monitoring 16 FBG sensors distributed across multiple metallic structures, operating over a 35 nm wavelength span. The system autonomously identifies sensor resonances, dynamically tracks spectral shifts, and reconfigures interrogation wavelengths in response to localized acoustic events. Using pencil-lead break tests as calibrated AE sources, we show simultaneous multi-channel detection and adaptive spatial localization. The combination of narrow linewidth (<10 kHz), wide tunability, and ML-driven calibration enables robust, scalable, and high-resolution sensing. This approach establishes a pathway toward fully autonomous, distributed photonic sensing networks for real-time structural health monitoring.
arXiv:2607.06746v1 Announce Type: new
Abstract: All published models of ultraviolet (UV) inactivation of airborne viruses in saliva droplets have neglected UV light scattering. To the best of our knowledge, this work presents the first Computational Fluid Dynamics-Discrete Dipole Approximation (CFD-DDA) platform for investigating the physical mechanisms governing UV disinfection of virus-laden airborne saliva droplets. The DDA solver predicts UV light scattering by both spherical and irregularly shaped saliva droplets, while the CFD solver predicts droplet evaporation and transport in airflow. By coupling the DDA and CFD solvers, we demonstrate that infected saliva droplets, whether spherical or irregularly shaped due to evaporation, experience highly non-uniform UV light scattering that significantly affects virus inactivation and cannot be neglected. This phenomenon has not previously been investigated within a fully three-dimensional framework. The coupled Euler-Lagrange CFD-DDA model further quantifies the effects of (i) the initial droplet size distribution and concentration, (ii) airflow rate, and (iii) droplet interactions with the surrounding airflow and bounding walls on the total number of surviving coronavirus copies $N_s$, assuming a virion diameter of 100 nm, an air temperature of 21 $^{\circ}$C, and a relative humidity of 65%. Based on the DDA results, a new virus inactivation model, referred to as the Dbouk-Yurkin law, is proposed. This model extends the classical Chick-Watson law by explicitly accounting for UV light scattering in both spherical and non-spherical airborne saliva droplets. The proposed three-dimensional CFD-DDA platform provides a powerful framework for improving the understanding of UV-based airborne virus disinfection and for optimizing the design and performance of UV air purification systems.
arXiv:2607.06759v1 Announce Type: new
Abstract: Precise measurement of the beam sigma matrix is essential for matching the optics in transport lines and ensuring reliable accelerator operation. In this work, we present a method for measuring and reconstructing the non-temporal five-dimensional beam sigma matrix using quadrupole scans performed in a dispersive transport region. The proposed approach enables characterization of the beam moments using only quadrupoles and beam transverse profile diagnostics, without requiring longitudinal diagnostics or a dedicated beamline section. To achieve robust and computationally efficient reconstruction, we formulate the problem within a differentiable simulation framework, allowing direct gradient-based optimization of the initial beam covariance matrix. We demonstrate the method experimentally in the Booster-to-Storage-ring (BTS) transport line at the Advanced Photon Source (APS), where it produces consistent reconstructions of the beam sigma matrix from measurements. We further show that the framework is flexible with respect to the number and placement of diagnostic screens, making it applicable to a broad range of existing transport-line configurations. These results establish the proposed 5D beam sigma matrix reconstruction method as a practical and broadly deployable approach for fast, efficient beam characterization during accelerator operation.
arXiv:2601.18644v2 Announce Type: replace
Abstract: The European Central Bank (ECB) is working on the "digital euro", an envisioned retail central bank digital currency for the Euro area. In this article, we take a closer look at the "digital euro FAQ", which provides answers to 26 frequently asked questions about the digital euro, and other published documents by the ECB on the topic. We question the provided answers based on our analysis of the current design in terms of privacy, technical feasibility, risks, costs and utility. In particular, we discuss the following key findings:
(KF1) Central monitoring of all online digital euro transactions by the ECB threatens privacy even more than contemporary digital payment methods with segregated account databases.
(KF2) The ECB's envisioned concept of a secure offline version of the digital euro offering full anonymity is in strong conflict with the actual history of hardware security breaches and mathematical evidence against it.
(KF3) The legal and financial liabilities for the various parties involved remain unclear.
(KF4) The design lacks well-specified economic incentives for operators as well as a discussion of its economic impact on merchants.
(KF5) The ECB fails to identify tangible benefits the digital euro would create for society, in particular given that the online component of the proposed infrastructure mainly duplicates existing payment systems.
(KF6) The design process has been exclusionary, with critical decisions being set in stone before public consultations. Alternative and open design ideas have not even been discussed by the ECB.
arXiv:2603.15685v2 Announce Type: replace
Abstract: Omnimodal large language models (OmniLLMs) jointly process audio and visual streams, but the resulting long multimodal token sequences make inference prohibitively expensive. Existing compression methods typically rely on fixed window partitioning and attention-based pruning, which overlook the piecewise semantic structure of audio-visual signals and become fragile under aggressive token reduction. We propose Dynamic Audio-driven Semantic cHunking (DASH), a training-free framework that aligns token compression with semantic structure. DASH treats audio embeddings as a semantic anchor and detects boundary candidates via cosine-similarity discontinuities, inducing dynamic, variable-length segments that approximate the underlying piecewise-coherent organization of the sequence. These boundaries are projected onto video tokens as a soft temporally co-registered segmentation prior. Within each segment, token retention is determined by a tri-signal importance estimator that fuses structural boundary cues, representational distinctiveness, and attention-based salience, mitigating the sparsity bias of attention-only selection. This structure-aware allocation preserves transition-critical tokens while reducing redundant regions. Extensive experiments on AVUT, VideoMME, and WorldSense demonstrate that DASH maintains competitive or superior accuracy while achieving higher compression ratios compared to prior methods. Code is available at: https://github.com/laychou666/DASH.
arXiv:2607.06833v1 Announce Type: new
Abstract: Sampling stochastic signals supported on a graph underlies many graph machine learning tasks, including recommender systems, forecasting in financial markets, and wireless network optimization. In these settings, the target signals are realizations of unknown conditional distributions. However, prevailing approaches rely mostly on intricate, application-tailored designs that often regress to a conditional mean instead of sampling from the conditional law. This paper unifies such problems as conditional graph signal generative modeling and tackles them with a single denoising diffusion framework. We learn a reverse diffusion process, parametrized by graph neural networks (GNNs), that draws graph signals conditioned directly on the graph topology and on node-feature side information. The reverse process is realized by a novel architecture, the U-Graph Neural Network (U-GNN), which generalizes the image-convolutional U-Net to graph-structured signals. The U-GNN performs multi-resolution encoder--decoder processing in which pooling and unpooling reduce to a learned node selection, expressed by nested selection matrices, and a zero-padded lifting of coarse signals back to the full node set. The graph convolutions are carried out on the original graph, with a stride that sets their hop reach, so the U-GNN bypasses explicit graph coarsening at every resolution. We demonstrate our method on two generative tasks: stock price forecasting and optimal wireless resource allocation, with extensive numerical results in both domains.
arXiv:2607.07676v1 Announce Type: new
Abstract: Autonomous AI agents can execute complex tasks with limited human review, yet they often lack the grounded operational knowledge to make their outputs not just executable but correct, secure, and maintainable. We introduce SkillCenter, to our knowledge the largest open skill library for agents by total count: 216,938 structured skills across 24 domain bundles. A SkillGate-filtered pipeline contributes 114,565 source-grounded skills from peer-reviewed journals, ArXiv, and over 24,000 technical sources, integrated with 102,373 community skills from GitHub and the ClawHub marketplace. We present the end-to-end framework that builds the pipeline subset: multi-source acquisition, an LLM-based quality gate (SkillGate), template-driven generation, iterative source-grounding, and quality-controlled publishing. Source grounding is a traceability guarantee: each retained claim maps to an exact quotation in its source. All skills ship as offline-searchable SQLite FTS5 bundles.
arXiv:2607.07226v1 Announce Type: new
Abstract: Software-defined vehicles (SDVs) are revolutionizing transportation by integrating complex, interconnected hardware, and software systems. This evolution introduces significant security challenges. We present a comprehensive security analysis for SDVs, focusing on software vulnerabilities. We note that existing vulnerability assessment tools fall short in addressing operating systems vulnerabilities, particularly when it comes to efficiently analyzing diverse software stacks in realistic environments. We present and release a vulnerability assessment solution that efficiently addresses these limitations. Our approach combines systematic vulnerability discovery, leveraging public Common Vulnerabilities and Exposures (CVE) databases, within a dockerized development environment that evaluates exploitability risks. The results reveal both breadth of potential threats and the practical constraints we faced during exploitation. We discuss the implications for industry and research, and propose directions for building more resilient SDVs.
arXiv:2601.21476v2 Announce Type: replace
Abstract: On-policy reinforcement learning (RL) for language model post-training suffers from a fundamental tension: as training progresses, policy entropy collapses and sampling diversity diminishes, causing the model to ``forget'' its own earlier exploratory capacity. While off-policy data can restore diversity, existing methods mix entire trajectories at the sequence level, introducing severe policy mismatch and training instability. We argue that the core question is not \emph{whether} to use off-policy data, but \emph{where} in the sequence it should appear. Based on this insight, we propose \textbf{Thinking Seeds}, a token-level mix-policy framework that uses the model's own historical checkpoints as off-policy prefixes, providing diverse starting points for reasoning, while the critical continuation is generated on-policy to preserve gradient quality. Through token-level importance ratios, Thinking Seeds effectively leverages historical diversity without compromising training stability. Extensive experiments across models and mathematical reasoning benchmarks demonstrate that Thinking Seeds consistently outperforms standard on-policy training and existing off-policy extensions. Our analysis reveals that the method maintains higher effective entropy, reduces gradient loss from clipping, and expands the explorable solution space, clarifying how position-aware mix-policy modeling improves both exploration and final performance in LLM RL.
arXiv:2603.19742v2 Announce Type: replace
Abstract: Understanding the internal mechanisms of transformer-based large language models (LLMs) is crucial for their reliable deployment and effective operation. While recent efforts have yielded a plethora of attribution methods attempting to balance faithfulness and computational efficiency, dense component attribution remains prohibitively expensive. In this work, we introduce Dual Path Attribution (DPA), a novel framework that faithfully traces information flow on the frozen transformer in one forward and one backward pass without requiring counterfactual examples. DPA analytically decomposes and linearizes the computational structure of the SwiGLU Transformers into distinct pathways along which it propagates a targeted unembedding vector to receive the effective representation at each residual position. This target-centric propagation achieves O(1) time complexity with respect to the number of model components, scaling to long input sequences and dense component attribution. Extensive experiments on standard interpretability benchmarks demonstrate that DPA achieves state-of-the-art faithfulness and unprecedented efficiency compared to existing baselines.