Forskningsradar

Science Journals

Peer-reviewade publikationer — 48947 artiklar

Inverse-LLaVA: Rethinking Multimodal Alignment via Text-to-Vision Mapping
arXiv:2508.12466v2 Announce Type: replace Abstract: Traditional multimodal learning approaches rely on alignment pre-training to bridge vision and language modalities, typically by projecting visual features into discrete text token spaces using large-scale image--text data. We revisit this design choice and propose Inverse-LLaVA, a multimodal architecture that inverts the conventional mapping direction by projecting text embeddings into continuous visual representation space and performing fusion within intermediate transformer layers. This representation-first design enables effective multimodal reasoning without relying on an explicit alignment pretraining stage and significantly reduces dependence on large alignment datasets. Across nine multimodal benchmarks, Inverse-LLaVA demonstrates strong learning efficiency under reduced supervision, achieving substantial gains on reasoning-intensive tasks while exhibiting selective performance drops on perception tasks that depend on explicit visual--text grounding. Our analysis indicates that these trade-offs primarily reflect differences in supervision regime rather than architectural limitations. Together, these results show that alignment pretraining is not strictly required for effective multimodal reasoning and highlight the importance of preserving continuous modality representations, opening a new direction for multimodal architecture design that decouples representation structure from supervision regime for more flexible and efficient multimodal systems.
The Test Oracle Problem in Synthetic LLM-as-Judge Corpora: Disappearance, Distortion and a Validation Protocol
arXiv:2607.13707v1 Announce Type: new Abstract: Studies of bias in LLM-as-judge systems typically build synthetic corpora by prompting an LLM to generate a hallucinated answer to pair with a factual one, then presenting both to a judge. We report a case in which this generation step silently failed, and use it to argue that the failure mode is structural rather than incidental. In a multilingual (Turkish/English) faithfulness-judgment corpus, a decoding-budget parameter shared between judging and generation calls truncated one producer's hallucinated answers to a few words. The resulting items produced a large, statistically robust effect: a 32-point cross-lingual collapse in one judge's selection accuracy, replicated from N=50 to N=500, explained by a three-layer mechanistic account, and confirmed by a controlled producer-swap experiment, none of which was real. The effect vanished to ceiling once the shared parameter was corrected, and only manual reading of the raw generations, not any aggregate statistical check, exposed the fault. A second measured bias (Markdown-formatting preference) was not fabricated but distorted by the same fault, its magnitude and in one case its sign shifting with stimulus length, a mode aggregate metrics cannot distinguish from the first. We frame the underlying vulnerability using the test oracle problem: corpora whose negative examples are LLM-generated carry no mechanical way to verify item integrity, while corpora built by deterministic perturbation of a gold answer carry an item-level oracle for free. A positive control supports this claim directly: an analogous fault injected into a minimal perturbation-based corpus is caught with 100% accuracy by a zero-cost, zero-human gold-to-negative string comparison. We close with a validation protocol, derived from our own case, for analysts working in the oracle-less regime that we argue describes most contemporary multilingual LLM-as-judge corpora.
Groc-PO: Grounded Context Preference Optimization for Truthful Multimodal LLMs
arXiv:2607.13712v1 Announce Type: new Abstract: Despite the rapid progress of Multimodal Large Language Models (MLLMs), they still suffer from untruthfulness issues, such as visual hallucinations, content fabrication, and unfaithful reasoning, which substantially undermine their faithfulness and practical utility. Alignment methods based on human preference, such as Direct Preference Optimization (DPO), have been widely adopted to address these issues. However, multimodal reasoning errors often propagate across stages, and final-answer errors can often be traced to mistakes in early grounding stages, yet standard DPO typically applies preference optimization at the final-answer level. This credit-assignment challenge means that supervision for early grounding stages is indirect rather than stage-specific, making it difficult to suppress error propagation arising from grounding drift and context inconsistency. To address this, we propose Grounded Context Preference Optimization (Groc-PO), a grounded preference optimization framework for MLLMs. We further construct the Grounded Context Preference Dataset (GCPD), organizing multi-stage preference samples around three stages of Object Grounding, Contextual Grounding, and Grounded Reasoning, to capture the formation, integration, and utilization of grounded context. By introducing more explicit preference supervision over multiple grounded stages, Groc-PO strengthens context-dependent reasoning and mitigates cross-stage error propagation. Extensive experiments show that, compared with standard DPO and other strong baselines, Groc-PO achieves improved performance in hallucination mitigation, faithful reasoning, and overall reliability, supporting the value of more explicit grounded supervision for trustworthy multimodal reasoning.
Mono-Z Dark Matter Search with Neural Spline Flows Using CMS Run 2015D Open Data
arXiv:2607.13771v1 Announce Type: new Abstract: We report a search for dark matter (DM) produced in association with a leptonically decaying \(Z\) boson at \(\sqrt{s}=13\) TeV using CMS Run 2015D open data corresponding to an integrated luminosity of \(2.32\,\mathrm{fb}^{-1}\) together with simplified-model Monte Carlo simulation. Events are selected in the mono-\(Z\rightarrow\ell^+\ell^-\) final state in both the \(\mu\mu\) and \(ee\) channels. Forty kinematic observables are extracted from MINIAOD and MINIAODSIM, cleaned with physics-motivated selections, and reduced to a 37-dimensional feature vector. Five Neural Spline Flows are trained independently to model Standard Model background and mediator-specific DM signal densities. The per-event test statistic is constructed from the log-likelihood ratio between the signal and background density estimates, providing sensitivity across the full kinematic phase space without requiring a hard upper \(\mathrm{MET}\) threshold. A simultaneous profile-likelihood fit combining the two channels yields observed (expected) 95\% confidence level upper limits on the signal-strength parameter of \(\mu<0.0177\) (\(0.0018\)) for the scalar mediator, \(\mu<0.0362\) (\(0.0039\)) for the vector mediator, and \(\mu<0.0498\) (\(0.0069\)) for the axial-vector mediator. The observed limits are weaker than expected because of a residual high-\(\mathrm{MET}\) background-modeling discrepancy rather than evidence for a DM signal. To our knowledge, this is the first application of Neural Spline Flow likelihood-ratio scoring to a mono-\(Z\) dark matter search using CMS Run 2015D open data simultaneously in the \(\mu\mu\) and \(ee\) channels.
Interaction Density as a Behavioural Signature of Exhibit Type: A Minimal-Log Study from a Two-Venue Science Experience Centre
arXiv:2607.13724v1 Announce Type: new Abstract: Understanding how visitors engage with interactive exhibits usually calls for either labour-intensive manual observation or invasive multimodal sensing -- eye-tracking, cameras, wearables -- that few science centres can deploy at scale. We ask how much can be learned instead from the handful of fields that most touch-enabled exhibits already log by default: a session's start time, end time, and press count. Analysing 2,816 visitor sessions across eight exhibits at two venues of a science experience centre in Bengaluru, India, we derive interaction density -- presses per second -- as a simple behavioural signature, and use it to distinguish fast-paced games from slower, deliberate quizzes. Density does so cleanly (Mann-Whitney r=0.556) and predicts exhibit type on its own with a cross-validated AUC=0.778. But the data complicates the obvious story: games are not just more intense, visitors also dwell on them longer (r=0.172), reversing the intuitive trade-off between intensity and duration -- traced to exhibits whose escalating difficulty creates open-ended re-engagement loops rather than fixed endpoints. Density is not a universal replacement for existing metrics either: raw press count alone explains far more variance in dwell time (R^2=0.527) than density does (R^2=0.081), though combining both improves on either alone (R^2=0.667). Exhibit-level anomalies, a cross-venue replication check, and a session-length censoring artefact further stress-test rather than simply confirm these results. The broader case we make is methodological: minimal, privacy-preserving interaction logs -- not additional sensors -- can already support rigorous, falsifiable behavioural research at any science centre with touch-enabled exhibits.
Peak-End-Net: A Peak-End Rule Inspired Framework for Generalizable Video Aesthetic Assessment
arXiv:2607.13941v1 Announce Type: new Abstract: Video aesthetic assessment (VAA) aims to predict how aesthetically pleasing a video is, yet remains far less explored than other visual assessment tasks. Its progress is hindered not only by the scarcity of large-scale benchmarks, but also by the intrinsic subjectivity of aesthetic judgment, which is shaped by human perception. In this paper, we revisit VAA from a psychological perspective and propose \textit{Peak-End-Net}, a lightweight and interpretable framework inspired by the \textit{peak-end rule}, which suggests that people tend to judge a temporal experience mainly according to its salient moments and the ending. Building on this intuition, we first transfer knowledge from image aesthetic assessment (IAA) to VAA by introducing a pretrained IAA head to produce frame-wise aesthetic priors, which serve as surrogate signals for identifying aesthetically salient moments and guiding \textit{peak-end rule}-based temporal aggregation. To further capture how a video evolves aesthetically over time, we design an aesthetic rhythm encoder that models temporal progression beyond isolated moments. Additionally, we refine the overall assessment through a dynamic gated fusion mechanism to improve robustness under distribution shift. Our method is built on a frozen vision transformer (ViT) and requires only a small number of trainable parameters, making it scalable and parameter-efficient. Extensive experiments on two existing VAA benchmarks, including in-domain evaluation on VADB and cross-domain testing on DIVIDE-3K, demonstrate that our approach achieves state-of-the-art performance, affirming the value of psychologically grounded modeling for VAA. Our code and models are available at https://github.com/AMAP-ML/Peak-End-Net.
Anatomically Faithful but Temporally Blind: Auditing Attribution for Left-Ventricular Ejection-Fraction Estimation from Echocardiography
arXiv:2607.13738v1 Announce Type: new Abstract: Background and Objective: Deep video models estimate left-ventricular ejection fraction (EF) from echocardiography with near-expert accuracy, and post-hoc attribution (Chefer relevance for transformers, Grad-CAM for CNNs) is increasingly used to certify that models "look at the right place." Yet whether these explanations are faithful both spatially and temporally is unaudited. Because EF is defined by the end-systolic (ES) and end-diastolic (ED) frames, a faithful explanation must localize the left ventricle (space) and the decisive frames (time). Methods: We fine-tune two distinct EF regressors on EchoNet-Dynamic -- a self-supervised VideoMAE transformer and a Kinetics-pretrained R(2+1)D CNN -- and audit each with architecture-matched attribution along three axes: intersection-over-relevance (IoR) against LV masks, deletion AUC, and a temporal localization index on ES/ED frames, each relative to chance with per-case 95% CIs over 50 studies. A tubelet-occlusion probe separates attribution failure from model behavior. Results: Both models are anatomically faithful -- IoR 2.91x (VideoMAE) and 1.98x (R(2+1)D) above chance -- yet temporally blind: temporal localization is indistinguishable from chance (0.97--1.00) and no better than random attribution. Occlusion shows the models do not preferentially rely on ES/ED (0.90x chance), so temporal blindness reflects model behavior, not an attribution artifact. Conclusions: Spatial faithfulness does not imply temporal faithfulness. Attribution can certify anatomical grounding while masking that a model ignores the clinically decisive frames -- a caution for XAI-based validation of video diagnostic models and a call for temporally-aware training and evaluation.
Practical Framework for Power System Strength
arXiv:2607.13970v1 Announce Type: new Abstract: A novel analytical framework for power system strength was recently introduced in the IEEE Transactions on Power Systems, providing a unified formulation for assessing voltage and frequency strength. Building upon this formulation, this paper addresses a series of practical challenges for translating the theoretical framework into a real-world application. In particular, simplified analytical solutions for network-wide bus-level strength metrics are provided, together with compact expressions to capture the impact of relevant devices on strength. In addition, novel normalized strength metrics at a device level are defined, enabling the comparison of strength across different systems. A strength source model is introduced to study the behavior of devices under varying strength conditions. Finally, the framework is implemented in a real-world study case, demonstrating its applicability and potential as a practical tool for a comprehensive strength assessment.
The Nonsmooth Impact Direction (NSID) of Robotic Systems
arXiv:2607.13768v1 Announce Type: new Abstract: Collisions of rigid-link robots and rigid environments are often modeled as instantaneous events. Under this idealization, the impact forces become impulsive and the system velocities nonsmooth. In this work, we systematically analyze pre- and post-impact velocities focusing on what we refer to as the nonsmooth impact direction (NSID). We show that it is a characteristic direction of a robotic impact and largely independent of contact properties. The results are directly applicable to large classes of backdrivable robotic systems with rigid links. We address particularities of systems with nonelastic and flexible joints, unconstrained as well as constrained systems. Further, we show that the approach direction w.r.t the NSID sets the direction of the impulsive force in frictional, inelastic impacts. The comprehensive theoretical analysis of this work supported by an experimental validation may serve as a foundation for future planning and control algorithms for various robotic impact applications. These can include humanoid locomotion on a slippery surface or repetitive hammering.
Edge-decomposition into Two Triangular Forests is NP-complete
arXiv:2607.13999v1 Announce Type: new Abstract: Let $\mathcal F$ be a graph class that is closed under topological minors and 1-sums, has decidable membership, contains a triangle, and is not the class of all graphs. Recently, Lee, Liu, and Tsai [ICALP 2026] showed that the edge-decomposition problem into $k \geq 3$ elements of $\mathcal F$ is NP-hard. In particular, their general hardness reduction covers a long-standing problem on outerthickness (when $\mathcal F$ is the class of outerplanar graphs). On the other hand, it is well known that decomposing a graph into forests is polynomial-time solvable, as implied by work of Edmonds [J. Res. Natl. Bur. Stand. B. 1965]. In this paper, we take a first step toward determining the complexity of edge-decomposition problems into just two graphs (the case $k=2$). We consider the simplest possible graph class $\mathcal F$ satisfying the criteria above: the triangular forests, that is, graphs in which every 2-connected component is a triangle. We prove that determining whether a graph can be edge-decomposed into two triangular forests is NP-complete.
Experimental Characterization and Prediction of Radial and Thickness Mode Power Transfer Capability in Through-Metal Acoustic Power Transfer
arXiv:2607.13797v1 Announce Type: new Abstract: Through metal acoustic power transfer is an emerging wireless solution for battery charging in hazardous and sensitive environments where electronics are enclosed within sealed metal structures without electrical feed through. Power transfer is achieved utilizing reverse and direct piezoelectric effects via acoustic wave propagation through the metal barrier. The achievable power, often targeting hundreds of watts, is strongly influenced by different factors, such as, material properties, geometry, dimensions of the metal and piezo, and their bonding, making maximization of power transfer capability critical. This work experimentally investigates the terminal electrical characteristics of multiple prototypes, representing realistic scenarios. It compares power transfer capability in thickness and radial resonance modes for piezo metal assemblies, enabling appropriate mode selection and power electronics interface design. A figure of merit (FOM) is proposed for rapid screening and ranking of configurations as far as the power transfer capability is concerned.
Lyapunov Exponent as Physics-Informed Dense Reward: RL Discovery of Stabilization Beyond the Kapitza Pendulum
arXiv:2607.14001v1 Announce Type: new Abstract: We suggest using the Lyapunov characteristic exponent (LCE) as a dense reward signal for the reinforcement learning problem of stabilizing the inverted pendulum with vertical motion. With LCE, the agent not only successfully found the oscillatory motion known as the Kapitza pendulum but also damped the pendulum's pivoting, leaving it in a strictly upright position.
RainDancer: RGB-Event Video Deraining with Rain-Oriented Spiking Dynamics
arXiv:2607.13802v1 Announce Type: new Abstract: Video deraining aims to recover clean visual content from rainy videos for reliable perception under adverse weather. Existing methods mainly rely on RGB sequences and temporal redundancy, but RGB-only restoration remains ambiguous in dynamic rainy scenes, where rain streaks, textures, boundaries, motion, and occlusions may share similar visual patterns. Event cameras provide complementary motion-sensitive cues with high temporal resolution, but event streams also contain sensor noise and background-triggered responses, so direct RGB-Event fusion may introduce cross-modal interference. To address this issue, we propose RainDancer, a progressive RGB-Event video deraining framework based on a decompose-before-interact paradigm. The core idea is to separate rain and background components within each modality before cross-modal interaction. In the RGB branch, frame features are progressively decomposed into rain and background representations. In the event branch, a rain-oriented spiking neural network module captures sparse and bursty event dynamics associated with rain motion. Component-level fusion is then performed between semantically aligned representations for structure preservation and rain suppression. We further introduce event-domain supervision to regularize sparse event reconstruction, structural consistency, and gradient orientation. Experiments on synthetic and real RGB-Event video deraining datasets demonstrate superior quantitative performance, visual quality, and downstream perception robustness. Code is available at https://github.com/AE86-plus/RainDancer.
The Wulff bio-heat transfer model revisited: directional blood enthalpy transport, the biological Peclet number, and implications for laser-induced thermal therapy
arXiv:2607.14017v1 Announce Type: new Abstract: Bio-heat transfer models play a fundamental role in predicting temperature fields during laser-induced thermal therapy (LITT). Among continuum bio-heat transfer models, the Pennes equation remains the most widely adopted formulation. However, by representing blood perfusion as an isotropic volumetric source, it neglects the directional transport of thermal energy associated with blood flow. The Wulff model overcomes this limitation by incorporating blood averaged enthalpy transport directly into the heat flux. Despite its physical significance, the derivation of the Wulff formulation and the assumptions required to obtain its governing equation remain only briefly discussed in the original work. The aim of the present work is twofold. First, the physical formulation originally proposed by Wulff is revisited in order to clarify its derivation and the assumptions required to obtain the governing equation. In particular, the physical origin of the modified heat flux is investigated and an equivalent formulation with an independent metabolic source term is discussed. Second, the resulting model is assessed against the classical Pennes formulation through representative laser-induced thermal therapy benchmark problem. The numerical results show that accounting for blood flow directionality may substantially alter the predicted temperature field and the extent of thermal damage. A dimensionless analysis further leads to the definition of a biological Peclet number, which quantifies the magnitude of directional blood enthalpy transport relative to thermal diffusion. Finally, a simple extension accounting for venous stasis is proposed, mitigating the excessive temperature rise predicted by the original Wulff formulation
Neural-network-based material identification in photon-counting computed tomography using region-of-interest spectral features
arXiv:2607.13835v1 Announce Type: new Abstract: This work investigates the feasibility of neural-network-based material identification based on photon-counting computed tomography (PCCT) data. The input data were spectral vectors extracted from regions of interest (ROIs) in reconstructed tomographic slices of a phantom containing La-, Nd-, and Gd-based samples, as well as air, water, bone, and polymethyl methacrylate (PMMA). The original tomographic slices were acquired at 12 detector threshold settings (THL = 45, 55, 65, 75, 85, 95, 105, 115, 125, 135, 145, 165). For model training, the spectra were interpolated onto a uniform grid from THL 45 to THL 165 with a step of one THL unit. Large ROIs, small ROIs, and their combined dataset were considered. To avoid an overestimated performance caused by correlated ROIs extracted from the same tomographic slice, the data were split into training, validation, and test subsets at the slice level.
An Epidemic Threshold Set for Networks
arXiv:2607.14048v1 Announce Type: new Abstract: In this paper, we investigate a discrete-time SIS epidemic model and the epidemic thresholds on complex networks. We focus on proposing a community-level epidemic threshold set and establishing a comparative result between the local epidemic thresholds and the global epidemic threshold. To verify our theoretical findings and structural properties, we conduct numerical experiments on one synthetic network (Network1) and one real-world network (the Haslemere contact network). Our numerical simulations, along with the computation and statistical ranking of the epidemic threshold sets, align accurately with our theoretical results.
Condition for $1/f$ noise to occur along with an example for a diffusion equation
arXiv:2607.13856v1 Announce Type: new Abstract: While $1/f$ noise is ubiquitous and has been found in various systems, its physics remains uncertain. From an analytical study of an ordinary diffusion equation, we find an additional example of the $1/f$ noise. The formula for this example, together with existing knowledge about scaling in fluid turbulence, implies a necessary and sufficient condition for the occurrence of any stationary $1/f$ noise. That is, the noise needs to be characterized by two constant frequencies of $f_{\rm low} \ll f_{\rm high}$. For a frequency range from $f = f_{\rm low}$ to $f_{\rm high}$, it is further needed that, except for the mean amplitude of the noise, there is no other constant parameter. Then, at $f_{\rm low} \ll f \ll f_{\rm high}$, the noise scales asymptotically as $1/f$. Being statistical and simple, our condition applies to any system and hence explains the ubiquity of the $1/f$ noise. It is also applicable to some systems with noise of $\alpha \ne 1.0$ for $1/f^{\alpha}$, via intermittency analogous to that of the turbulence.
The Dynamic Verifiable Multi-Agent Human Agentic Loyalty Loop (DVM-HALL) Model and the Net Human-Agent Score (NHAS) in Autonomous Commerce
arXiv:2607.13998v1 Announce Type: new Abstract: The rapid proliferation of Agentic Artificial Intelligence fundamentally disrupts traditional customer loyalty paradigms. As AI evolves from passive recommendation algorithms to autonomous, goal-directed agents capable of executing purchasing decisions, the conventional understanding of consumer-brand relationships requires a structural reevaluation. By synthesizing extant literature across human-machine teaming, consumer decision-making, and algorithmic trust dynamics, we demonstrate that traditional loyalty models fail to account for algorithmic bounded rationality and constructed autonomy. To address this, we introduce the Dynamic Verifiable Multi-Agent Human Agentic Loyalty Loop (DVM-HALL) model. We formalize brand choice via a softmax probability formulation where human emotional equity, agentic machine-experience utility, calibrated trust, delegated authority, and verifiable execution jointly determine selection. The model features recursive updating mechanisms to dynamically calibrate trust and delegation after each interaction. Crucially, the framework integrates a verifiable execution layer for Decentralized Finance (DeFi) and tokenized loyalty settings, incorporating execution risks -- such as gas costs, slippage, MEV exposure, and smart-contract vulnerabilities -- as core predictors of agentic brand preference. Furthermore, we introduce the Net Human-Agent Score (NHAS), an auditable, risk-weighted metric designed to measure human-agent alignment using human feedback, execution logs, benchmark comparisons, and verifiable receipts. Finally, we propose a comprehensive three-stage empirical validation plan spanning controlled shopping experiments, multi-agent market simulations, and DeFi testbeds. This framework provides the foundational theory required for brands to navigate the impending transition toward machine customers.
Multi-Expert Routing for Multi-Domain Low-Resource OCR: A Manchu Case Study
arXiv:2607.14041v1 Announce Type: new Abstract: Historical Manchu OCR must accommodate various visually distinct writing styles, including regular script, running script, and the semi-cursive chancery hand used in palace memorials, despite limited labeled data. We study a multi-expert system that reuses checkpoints from an iterative fine-tuning process as domain specialists and uses a lightweight page-level image classifier to dispatch pages by visual style. When the checkpoint pool lacks a suitable specialist, we train an additional expert for that domain. On three frozen test sets, the routed system matches the selected specialist for each style at two-decimal precision: 0.30 percent CER on regular script, 1.57 percent on memorials, and 4.83 percent on running script. The router achieves 99.3 percent page-level domain accuracy and matches the domain-label oracle at the same precision. Two of the three selected specialists were not trained specifically for their final domain; only the running-script expert was trained with that domain as its target. We report the evaluation protocol, router design, and per-page predictions to make the comparison reproducible.
Relevance-Aware Rule: Structural Deletion of Irrelevant Conditions in Decision Trees
arXiv:2607.13874v1 Announce Type: new Abstract: Decision trees generate interpretable if--then rules, yet they contain irrelevant conditions (IRCs). These IRCs arise from the structural mechanism of tree splitting and persist even in modern optimal sparse tree induction algorithms. Existing IRC deletion methods overlook this structural mechanism; therefore, they either preserve the original tree too loosely to remain reliable, or too strictly to achieve meaningful simplification. This study provides theoretical foundations for reliable IRC deletion by establishing theorems and propositions related to the underlying IRC mechanism. The key finding is that a binary split shifts class proportions in opposite directions relative to the parent. Specifically, an increase in the class-1 proportion along one branch necessitates an increase in the class-0 proportion along its sibling, thereby generating a C1-link and a C0-link. Based on this structural fact, we propose a structural IRC deletion framework. Relative to each leaf, links that increase the leaf-class proportion are matched, whereas links that increase the proportion of the opposite leaf-class are mismatched. These mismatched links are flagged as structurally suspicious IRC candidates. Rather than deleting them outright, the framework rigorously diagnoses their relevance by assessing prediction reliability. It selectively deletes conditions that are structurally and empirically irrelevant, while strictly protecting those whose deletion would reduce the rule's reliability. Experimental results confirm that the proposed framework achieves substantial rule simplification without sacrificing the reliability of the original tree.
Deep Interaction: An Efficient Human-AI Interaction Method for Large Reasoning Models
arXiv:2607.14049v1 Announce Type: new Abstract: The emergence of Chain-of-Thought (CoT) reasoning has significantly enhanced the ability of large language models (LLMs) to tackle complex, multi-step tasks. However, when errors occur, current interaction approaches typically involve re-generating another response that may make mistakes again, or users laboriously flag the faulty step in follow-up turns that may get responses <You are right, I made a mistake here> followed by similar errors recurring. To address this issue, we propose an efficient human intervention mechanism for precisely correcting reasoning errors in LLMs, termed Deep Interaction. Our approach enables direct editing of the original response, allowing erroneous parts to be corrected while preserving accurate reasoning steps. We refine the edited CoT into a distilled prompt, which then steers the LLM along the corrected reasoning path. Experimental results show that our method achieves over a 25% improvement in correction success rate and reduces token usage by approximately 40% on STEM tasks reasoning compared to baseline approaches.
Transforming Rank: How Architecture Navigates the Spectral Pathologies of Depth
arXiv:2607.14018v1 Announce Type: new Abstract: We investigate how each component of the Transformer feedforward block architecture design determines how much rank survives across depth at initialization. We reinterpret skip connections and normalization, long understood as controlling magnitude, as mechanisms for preserving gradient rank across depth, since the very matrix multiplications and nonlinear activations that make the network expressive also reduce the rank. We show that skip connections trade off rank collapse against ensemble-like behavior, controlled by the relative scales of the branch and the skip: skip connections route the gradient around the residual branch, where rank is lost, rather than along the long gradient paths that encourage the layers to compose. The placement of the normalization layer controls this same tradeoff by setting the branch-to-skip ratio across depth, unifying much of the normalization placement and depth scaling literature, in particular why rank collapses for Post-Norm but plateaus for Pre-Norm. Other aspects of the architecture, like the two-matrix structure that expands and contracts the width, use additional parameters to preserve the representation or branch Jacobian rank. The second matrix decorrelates a coherent mean spike that would grow across blocks with a single matrix and uncentered activation, preventing the residual representation from collapsing. The width expansion between the two matrices keeps the branch Jacobian full rank: applying the rank-reducing activation in this expanded space leaves enough directions to span the original, at a width that follows a Marchenko--Pastur law. The initialization rank of the input--output Jacobian predicts which networks train on CIFAR-10. Taken together, we recast architecture design for deep networks as navigating an intrinsic tradeoff among rank collapse, ensemble-like behavior, and parameter count.
High-Order Question Generation in a Multilingual Educational Context
arXiv:2607.13901v1 Announce Type: new Abstract: Critical thinking is a fundamental skill that helps learners move beyond simple memorization. One way to develop this skill is through high-order questioning. However, crafting such questions remains a challenge for educators, and classroom practices tend to rely on low-order questions. Large Language Models have demonstrated strong capabilities in generating high-order questions, especially when guided by prompts based on Bloom's Taxonomy. Yet, existing research has largely centered on this framework and focused only on English. This study addresses these gaps by introducing prompts grounded in two alternative frameworks: Claim-Evidence-Reasoning and Divergent Questioning within a multilingual context using Basque, Spanish, and English. Results indicate that while both an open-source and a proprietary model rather effectively generate questions in all three languages, only about half of the answerable questions are recognized by teachers as high-order. A positive finding is that the alternative frameworks produce structurally and conceptually varied questions, suggesting they could complement each other and provide viable alternatives to Bloom's Taxonomy.
SPECS: Speciated Evolutionary Circuit Synthesis
arXiv:2607.14027v1 Announce Type: new Abstract: We propose SPECS, a genetic algorithm for automated analog circuit synthesis with joint topology and sizing optimization. SPECS is inspired by NeuroEvolution of Augmenting Topologies (NEAT), an evolutionary algorithm originally developed to synthesize neural networks. By reformulating the genome representation and adapting the genetic operators to the analog circuit domain, we successfully transfer the core principles of NEAT to analog circuit synthesis. Circuit-specific wiring constraints are incorporated to ensure valid and physically meaningful designs throughout the evolutionary process, and speciation is used to preserve innovation while maintaining population diversity. We evaluate the proposed method on a set of computational circuit synthesis tasks consisting of square, cube, square root, and cube root functions. Experimental results demonstrate that SPECS outperforms benchmark methods across all tasks in both solution quality and reliability. The synthesized circuits and their schematics are available in the supplementary repository.
Total variation cutoff for Kac's walk on the sphere
arXiv:2607.13401v1 Announce Type: cross Abstract: We prove cutoff in total variation distance for the discrete-time Kac walk on $S^{n-1}$ started from a coordinate vector. The cutoff occurs at $ C_{\mathrm{BRW}}n\log n$, where $C_{\mathrm{BRW}} \approx 3.8916$ is an explicit constant determined by the speed of the leftmost particle in a branching random walk. In particular, the cutoff location is not at the conjectured time $ 2n\log n$.