Forskningsradar

Science Journals

Peer-reviewade publikationer — 54516 artiklar

The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metric
arXiv:2607.18237v1 Announce Type: new Abstract: Human visual similarity judgments are context-dependent. For example, two images may be similar in shape but distinct in color. Existing perceptual similarity metrics, however, collapse these nuances into a single scalar value, offering no mechanism to condition on specific aspects. To bridge this gap, we introduce a large-scale dataset of human similarity judgments over image triplets, where each triplet is annotated across multiple, free-form semantic aspects of similarity. Benchmarking a broad range of frontier vision-language models (VLMs) reveals a considerable performance gap compared to human annotators' consensus. Leveraging our data, we fine-tune a VLM to produce our Text-Prompted Image Perceptual Similarity (TPIPS) metric, capturing multiple senses of visual similarity depending on the specified text prompt. We demonstrate that TPIPS aligns more closely with human perception and generalizes reliably beyond the training distribution. Finally, we show that TPIPS unlocks new capabilities in text-guided retrieval, compositional search, and the fine-grained evaluation of generative models. Our code, data, and trained models are at https://peterwang512.github.io/TPIPS
A Geometric Perspective on Stabilizing Value Conflict Resolution
arXiv:2607.17946v1 Announce Type: new Abstract: Large Language Models (LLMs) often struggle to navigate value conflicts when trained with the compressed scalar rewards of Reinforcement Learning from Human Feedback (RLHF). To address this challenge, we investigate how chain-of-thought (CoT) reasoning can help improve performance in this domain. Geometrically, we show that CoT correlates with further smoothing the model's loss landscape in its sharpest direction, helping resolve the optimization instability of traditional scalar rewards. We also demonstrate via relevant downstream benchmarks that value conflict-focused CoT may generalize to different kinds of moral reasoning, demonstrating that this CoT has the potential to be an effective mechanism for better moral reasoning. To capitalize on this potential, we create a new value conflict-focused CoT design that further smooths the sharpest direction of the loss landscape and increases moral reasoning performance. This finding shows that explicitly modifying and improving the design of reasoning dynamics offers a promising avenue for improving model performance on user requests with complex value conflicts, advancing pluralistic alignment in LLMs.
A principled closure framework for higher-order SIS epidemic models on networks
arXiv:2607.18003v1 Announce Type: new Abstract: Susceptible-infected-susceptible (SIS) epidemic models on networks are governed by hierarchical moment equations where the dynamics of smaller subsystems depend on the state of larger ones. Moment closure approximations, which truncate this hierarchy by expressing higher-order state probabilities in terms of lower-order ones, are essential for obtaining tractable reduced systems. Higher-order networks, which extend the pairwise structure to include group interactions, introduce a combinatorial explosion of closure configurations, making systematic derivation harder. Consequently, existing higher-order SIS models are derived heuristically, where structural and dynamical assumptions underpinning their closures are not always apparent from the formulation alone. We develop a bottom-up derivation of higher-order SIS dynamics, building systematically from node-level equations to pairs, triplets, and three-body interactions. Central to our approach is a network-dependent closure operator that generates topologically appropriate approximations from local pairwise and triadic structure. Using this framework, we recover three existing higher-order SIS models--Burgio et al.'s maximal clique, Malizia et al.'s pair-based and inter-order models--as special cases, each arising under specific topological and dynamical assumptions. Our derivation reveals assumptions that are invisible from heuristic approaches: for instance, Malizia et al.'s inter-order overlap parameter is insufficient alone to express the model within our framework despite performing well against simulations, with the original derivation implicitly invoking additional structural assumptions. Our framework offers both a foundation for higher-order epidemic modeling and a constructive pathway for understanding the assumptions implicit in heuristically derived mean-field closures and provides a principled method of generating new models.
Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention
arXiv:2507.07247v2 Announce Type: replace Abstract: As large language models (LLMs) and visual language models (VLMs) grow in scale and application, attention mechanisms have become a central computational bottleneck due to their high memory and time complexity. While many efficient attention variants have been proposed, there remains a lack of rigorous evaluation on their actual energy usage and hardware resource demands during training. In this work, we benchmark eight attention mechanisms in training GPT-2 architecture, measuring key metrics including training time, GPU memory usage, FLOPS, CPU usage, and power consumption. Our results reveal that attention mechanisms with optimized kernel implementations, including Flash Attention, Locality-Sensitive Hashing (LSH) Attention, and Multi-Head Latent Attention (MLA), achieve the best energy efficiency. We further show that lower GPU power alone does not guarantee reduced energy use, as training time plays an equally important role. Our study highlights the importance of energy-aware benchmarking in attention design and provides a practical insight for selecting resource-efficient mechanisms. All our codes are available at GitHub.
Super-resolution imaging enabled by higher-order Bessel Gaussian beams in nanoscale optical structures
arXiv:2607.17458v1 Announce Type: new Abstract: In conventional optical microscopy, accessing subwavelength information is classically constrained by the Abbe diffraction limit which remains a significant challenge in nanophotonics. To overcome this limitation, we introduce a scheme that generates a tightly confined near-field focal spot under non-diffracting Bessel beam illumination, employing a series of high refractive-index nanoscale structures. Furthermore, the utilization of higher-order Bessel beams enables additional resolution enhancement beyond the diffraction limit. Our results demonstrate a subwavelength resolution of (lambda/53) with a pyramidal nanostructure. To elucidate the factors governing the focusing behavior, we systematically investigate the influence of different geometrical parameters related to the incident Bessel beam on the focusing performance and shows that these factors critically determine the stability and spatial profile of the focal spot. These findings highlight the potential of the proposed approach for various applications in super-resolution imaging and quantum technology.
On the Complexity of the Skolem Problem at Low Orders
arXiv:2507.11234v3 Announce Type: replace Abstract: The Skolem Problem asks to determine whether a given linear recurrence sequence (LRS) $\langle u_n \rangle_{n=0}^\infty$ over the integers has a zero term, that is, whether there exists $n$ such that $u_n = 0$. Decidability of the problem is open in general, with the most notable positive result being a decision procedure for LRS of order at most 4. In this paper we consider a bounded version of the Skolem Problem, in which the input consists of an LRS $\langle u_n \rangle_{n=0}^\infty$ and a bound $N \in \mathbb N$ (with all integers written in binary), and the task is to determine whether there exists $n\in\{0,\ldots,N\}$ such that $u_n=0$. We give a randomised algorithm for this problem that, for all $d\in \mathbb N$, runs in polynomial time on the class of LRS of order at most $d$. As a corollary we show that the (unrestricted) Skolem Problem for LRS of order at most 4 lies in $\mathsf{coRP}$, improving the best previous upper bound of $\mathsf{NP}^{\mathsf{RP}}$. The running time of our algorithm is exponential in the order of the LRS -- a dependence that appears necessary in view of the $\mathsf{NP}$-hardness of the Bounded Skolem Problem. However, even for LRS of a fixed order, the problem involves detecting zeros within an exponentially large range. For this, our algorithm relies on results from $p$-adic analysis to isolate polynomially many candidate zeros and then test in randomised polynomial time whether each candidate is an actual zero by reduction to arithmetic-circuit identity testing.
Investigation of the effects of superhydrophobic surface treatment on the dynamics of the flow in the near wake of a sphere using spatial dynamic mode decomposition
arXiv:2507.17091v3 Announce Type: replace Abstract: Viscous drag arises from the fluid at a surface having zero relative velocity, a phenomenon known as the no-slip condition. Superhydrophobic surfaces, when submerged in water, trap a layer of air in their surface texture, partially replacing the liquid-solid interface with a liquid-gas interface. This air layer, called the plastron, results in partial slip at the surface, thereby reducing the viscous drag. In turbulent flows, large fluctuations in pressure and velocity can deplete or completely remove the plastron from the surface. This makes evaluating the effects of superhydrophobic surface treatments on flow dynamics particularly challenging. This study examines the impact of a sustained plastron on the dynamics in the shear layer of a sphere, achieved by supplying air at low pressure through pores in the sphere's surface. Instantaneous planar velocities in the wakes of spheres, both with and without superhydrophobic surface treatment, are measured within a plane passing through the spheres' centre. Dynamic mode decomposition (DMD) is applied to the velocity fluctuations in the shear layer to evaluate how superhydrophobic surface treatment affects the instabilities there. It is shown that the addition of the pores has a relatively small effect on the instabilities in the shear layer, while they are significantly changed by the addition of superhydrophobic surface treatment when the plastron is sustained.
Decoding Desarguesian spread codes beyond half minimum distance
arXiv:2607.16890v1 Announce Type: new Abstract: Spread codes are a well-known family of constant-dimension subspace-metric codes. For constant dimension $k$ and ambient space dimension $n$ being a multiple of $k$, these codes have minimum distance $2k$ and a rich geometric structure. In this paper, we study the decoding capabilities of the Nearest Neighbor Decoder for Desarguesian spread codes, establishing that unique decoding is still achievable beyond half the minimum distance. Motivated by this, we develop a new decoding algorithm to uniquely decode Desarguesian spread codes in the presence of both insertions and deletions, which increase and decrease, respectively, the dimension of the transmitted codeword. Even when the sum of the dimensions of insertions and deletions exceeds half the minimum distance, provided that deletions are of dimension at most $k-2$, the algorithm succeeds with a small decoding failure. We also propose two refinements to this algorithm that, empirically, can handle nearly as many insertions as the Nearest Neighbor Decoder.
Absolute charge calibration of DRZ phosphor screens for relativistic electron bunches
arXiv:2607.17059v1 Announce Type: new Abstract: Laser-plasma accelerators have been the subject of extensive research in recent years. The electron beams they generate exhibit a broad energy spread. To conveniently characterize beams from laser wakefield acceleration (LWFA), electron spectrometers employing scintillating screens coupled with CCD cameras are typically used. In this work, we calibrate a series of DRZ phosphor screens and measure the spectra of the light they emit. The calibration was performed using the radio-frequency linear electron accelerator at Tsinghua University, which provided monoenergetic electron beams with peak energy of approximately 30 MeV.
Quantum-Centric Geometry Optimization with Wave-Function-Based Embedding
arXiv:2607.16410v1 Announce Type: cross Abstract: The EWF-(FCI,SQD) method, a wave-function-based embedding approach combining full configuration interaction (FCI) and sample-based quantum diagonalization (SQD), is a promising new tool for the simulation of molecular systems. However, applications of EWF-(FCI,SQD) have so far been limited to single-point calculations, whereas the study of complex chemical processes requires the ability to explore potential energy surfaces. In this work, we demonstrate geometry optimization with EWF-(FCI,SQD), scaling our simulations to molecules as large as menthone and benzidine within the STO-3G basis set. Without fragmentation, these systems comprise 73 and 82 molecular orbitals respectively, presenting an intractable Hilbert space for conventional exact or high-level subspace solvers and establishing a clear necessity for fragmentation-based methodologies. The underlying fragment SQD simulations in the EWF-(FCI,SQD) geometry optimizations use up to 70 qubits. The resulting geometries show exceptional accuracy relative to the classical reference, with deviations below 4 picometers.
Equilibrium analysis of three-player General Lotto game with leader-follower framework
arXiv:2607.17062v1 Announce Type: new Abstract: In this paper, we introduce the General Lotto game with a regulator (R-Lotto), a leader-follower extension of the classical two-player General Lotto game. The model captures regulatory interventions in competitive resource allocation, where a regulator first chooses an intervention parameter to influence the subsequent competition between two resource-constrained followers. The intervention parameter represents favoritism toward one of the followers, and the followers then play a general Lotto subgame with favoritism. We derive the followers' equilibrium payoff and characterize the Nash--Stackelberg equilibrium (NSE) intervention of the regulator. We further develop a multi-battlefield R-Lotto model with a regulator budget constraint. In this setting, the follower subgames on different battlefield is decoupled, while the regulator's intervention decisions are coupled through a common budget. Numerical simulations demonstrate the proposed equilibrium characterizations and provide practical decision-making guidance for the regulator.
MMGraphRAG: Bridging Vision and Language with Interpretable Multimodal Knowledge Graphs
arXiv:2507.20804v3 Announce Type: replace Abstract: Large Language Models (LLMs) suffer from hallucinations due to their static parametric knowledge. Retrieval-Augmented Generation (RAG) and GraphRAG mitigate this issue by incorporating external knowledge and structured reasoning over knowledge graphs (KGs). However, existing approaches remain largely text-centric, as constructing fine-grained multimodal knowledge graphs (MMKGs) with explicit cross-modal semantics remains challenging. In this paper, we propose MMGraphRAG, a framework for building interpretable MMKGs that unify textual and visual knowledge. Our approach represents visual content as structured scene graphs and integrates them with textual KGs through a novel cross-modal entity linking method, SpecLink, which leverages spectral clustering to jointly model semantic similarity and graph structure. This design preserves explicit entities, relations, and reasoning paths across modalities, enabling structure-aware retrieval and generation. To support evaluation, we introduce the CMEL dataset, a benchmark for fine-grained cross-modal entity alignment. Experimental results on CMEL demonstrate improved entity linking accuracy, while evaluations on DocBench and MMLongBench show that MMGraphRAG achieves superior performance and stronger robustness, particularly in complex multimodal reasoning scenarios.
HarmoHOI: Harmonizing Appearance and 3D Motion for Multi-view Hand-Object Interaction Synthesis
arXiv:2607.17097v1 Announce Type: new Abstract: Hand-Object Interaction (HOI) synthesis is a cornerstone for animation production and embodied AI. Despite the strong priors of video foundation models, multi-view consistent HOI synthesis remains challenging due to complex hand motions and occlusions. We present HarmoHOI, a unified diffusion framework that jointly and harmoniously generates synchronized multi-view HOI videos and globally aligned 3D point tracks. Our core insight is that robust multi-view consistency fundamentally requires globally aligned 3D geometry and motion. To this end, we propose a Mixture of Multi-view Diffusion Transformer that co-models RGB videos and 3D point tracks. By representing point tracks as pseudo-videos, we align 3D geometric signals with the 2D latent space of foundation models, thereby minimizing the domain gap and easing adaptation of priors. To further ensure geometry consistency, we introduce Global Motion Aligning Diffusion, which refines coarse point tracks into metric-scale, globally aligned 3D trajectories. HarmoHOI enables on-the-fly co-evolution of 2D appearance and 3D motion during denoising. To overcome the scarcity of multi-view HOI data, we employ a hybrid data curriculum learning strategy that successfully transfers generic priors from single-view data to synchronized multi-view generation. Experimental results show that HarmoHOI achieves state-of-the-art performance in visual quality, motion plausibility, and multi-view geometric consistency. Project page available at https://droliven.github.io/HarmoHOI_project.
Degeneracy-Guided List Compression for Greedy Graph Coloring
arXiv:2607.17029v1 Announce Type: new Abstract: We study degeneracy guided list compression for greedy graph coloring when graph structure is available before colors are sampled. Our exposure calibrated ordering framework assigns each vertex an independent uniform list according to its backward neighborhood in a color independent order. Its certified instantiation, Profiled Structure Aware Asymmetric Palette Sparsification, or P-SAPST, reverses a minimum degree removal sequence and obtains every backward exposure from the removal profile. For each fixed profile, we characterize the exact local budget required by independent uniform lists under history robust greedy recovery. The profile yields linear list volume on high degree forests and on a core fringe family where reciprocal rank allocation requires Theta(n log^2 n) sampled colors. Exact conflict expectation, concentration, and a dense exposure barrier complete the theoretical description. The evaluation contains 40,320 runs over SAPBench and two SNAP networks. At the theorem scale, P-SAPST reduces mean list size by 47.6 percent relative to calibrated APST while attaining 99.8 percent observed greedy success. P-SAPST Lite replaces peeling with a degree order and provides a lower latency order choice within the same framework. On stress graphs with 250,000 vertices and up to 1,251,868 edges, Lite obtains a payload ratio of 0.865, while calibrated APST obtains 7.886. On email Enron, the corresponding ratios are 0.193 and 5.814. Compression is strongest on hub dominated and power law graphs and disappears near the dense exposure barrier. The method complements edge oblivious streaming APST by addressing an offline regime in which structural plans can be reused.
Faster and simpler traversal of 0/1-polytopes
arXiv:2607.17590v1 Announce Type: new Abstract: Recently, Merino and M\"utze (FOCS'23+SICOMP'24) presented an algorithm for computing a Hamilton path on the skeleton of any 0/1-polytope ${\rm conv}(X)$, where $X\subseteq\{0,1\}^n$. The algorithm uses as a black box an algorithm for solving the classical linear optimization problem $\min\{w\cdot x\mid x\in X\}$ for some weight vector $w\in\mathbb{R}^n$. The resulting delay per visited vertex on the Hamilton path is only by a $\log n$ factor larger than the time to solve one instance of the optimization algorithm. In this paper, we make the Hamilton path algorithm simpler and faster. Namely, we obtain an amortized delay that is only by a constant factor larger than the running time of the optimization algorithm, thus removing the $\log n$ factor. As concrete results, this yields improved algorithms for generating bases and independent sets in a matroid, spanning trees, forests, matchings and maximum matchings in a graph, vertex covers, minimum vertex covers, independent sets and maximum independent sets in a bipartite graph, and antichains, maximum antichains and ideals in a poset. All of these listings correspond to Hamilton paths on the corresponding polytopes. Furthermore, we obtain an $\mathcal{O}(t_{\rm LP})$ amortized delay algorithm for the vertex enumeration problem on 0/1-polytopes $\{x\in\mathbb{R}^n\mid Ax\leq b\}$, where $A\in \mathbb{R}^{m\times n}$ and $b\in\mathbb{R}^m$, and $t_{\rm LP}$ is the time needed to solve the linear program $\min\{w\cdot x\mid Ax\leq b\}$. This improves upon the $\mathcal{O}(t_{\rm LP} \log n)$ delay algorithm of Merino and M\"utze, and the previous $\mathcal{O}(t_{\rm LP}\,n)$ delay algorithm of Bussieck and L\"ubbecke from 1998.
Toward Optimal Adenovirus Detection Using YOLO26
arXiv:2607.17799v1 Announce Type: new Abstract: This study systematically benchmarks different data augmentation setups across YOLO26 model size variants to determine the most effective setup for adenovirus detection in TEM images. The benchmarked setups include NAS, GAS, GMAS and DAS, all evaluated under identical training conditions. The adenovirus dataset, selected from the published TEM virus dataset, was re-annotated by leveraging adenovirus particle positions to generate YOLO-compatible bounding box annotations. The experimental results demonstrated the impact of the benchmarked data augmentation setups on adenovirus detection with YOLO26 and indicated the most effective data augmentation setup.
Linear extremal bounds for a family of forbidden $0$-$1$ matrices
arXiv:2607.16463v1 Announce Type: cross Abstract: Fulek defined the $0$-$1$ matrix \[ L_3=\begin{pmatrix} 1&0&0&1&0\\ 0&0&0&0&1\\ 0&1&1&0&0 \end{pmatrix} \] and asked whether $\text{ex}(n,L_3) = O(n)$. We prove that every $r\times s$ $0$-$1$ matrix avoiding $L_3$ has at most $27r+2s$ $1$ entries. Fulek's general lower bound construction has $6n-8$ $1$ entries, so \[ 6n-8\leq \text{ex}(n,L_3)\leq29n \] for $n\geq5$. The same argument applies to an infinite family. If $Q_{a,b,k,\ell}$ is the light three-row matrix with column word $1^a3^k1^b2^\ell$, where $a,b,\ell\geq1$ and $k\geq2$, then \[ \text{ex}(r,s,Q_{a,b,k,\ell}) \leq\bigl(5(k-1)(4b+1)+a+b+\ell-1\bigr)r+2s. \] This verifies a conjecture of Pettie and Tardos on linear light patterns for an infinite family that includes the previously unresolved weight-five pattern $L_3$. The proof assigns matrix entries to edges of a bar $1$-visibility hypergraph, cuts gaps to control the multiplicity of these edges, and charges the cuts to a noncrossing graph on the rows.
ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoning
arXiv:2607.17599v1 Announce Type: new Abstract: Video spatial reasoning is essential for navigation-oriented perception and long-video question answering, where models must infer spatial relations across long horizons under changing viewpoints. However, existing multimodal large language models (MLLMs) remain largely semantic-centric, and often fail to reliably aggregate consistent spatial evidence from redundant video observations, leading to inefficient or unstable reasoning. To address these issues, we propose ConsiSpace, a geometry-consistency-aware framework for geometry-sensitive video spatial reasoning that turns spatial consistency into both an evidence organization principle and an explicit post-SFT learning signal. We build a geometry-consistent memory (GCM) including implicit evidence tokens and explicit geometric cues, and leverage efficient organization strategies to compactly preserve task-related spatial evidence. Furthermore, we utilize unified consistency self-supervised reinforcement learning (UC-SSRL) after supervised fine-tuning to improve cross-view stability, with answer-, metric-, and topology-consistency rewards. Extensive experiments on three spatial-reasoning benchmarks, VSI-Bench, OSI-Bench, and MMSI-Video-Bench, show consistent gains, improving the average score by 12.6 points over the strongest baselines.
TaskArtisan: Designing Composable Generative Widgets for LLM-Assisted Analysis
arXiv:2607.17394v1 Announce Type: new Abstract: People increasingly use chatbots such as ChatGPT for everyday analysis tasks. While chatbots unify many analysis functions (e.g., scripts, visualizations, summaries), long conversations become hard to navigate, making it difficult to revisit prior steps or reuse successful workflows. LLMs now generate high-fidelity GUI code that enables people to create customized analysis tools beyond text. Yet, what new opportunities generative UIs bring to analysis work remain unclear. We interviewed six professionals about analysis with chatbots, analyzed publicly shared LLM-generated GUI tools, and conducted a comparison study (N=12) between a chatbot and TaskArtisan, a technology probe that enables people to create and assemble generative analysis UI widgets for sequential and fan-out composition. We find that GUI improved clarity and visual presentation but also introduced rigidity and additional prompting challenges. We summarize the trade-offs into a provisional design framework (malleability, specification, interoperability) to inform future generative UI in LLM-assisted analysis workflows.
Scanless quantum Fourier-transform mid-infrared spectroscopy for rapid high-sensitivity hyperspectral mapping
arXiv:2607.17964v1 Announce Type: new Abstract: Fourier-transform infrared (FTIR) spectroscopy is a well-established technique for qualitative and quantitative chemical analysis. Classical FTIR systems rely, however, on direct mid-infrared (mid-IR) scan-based time-domain measurements of coherence functions; thus, the signal-to-noise ratio and measurement speed are constrained by design. In this paper, we demonstrate a scanless quantum FTIR (sQFTIR) technique that exploits principles of metrology with entangled photons to circumvent the limitations inherent to classical FTIR systems. The approach exploits the interferometric nature of the sensing paradigm and relies on frequency-domain measurements performed with a static, low-gain nonlinear interferometer. A robust reconstruction algorithm is used to retrieve time-domain signals and reconstruct respective mid-infrared (mid-IR) spectra (3000$~$cm$^{-1}$ to 2380$~$cm$^{-1}$) from near-IR measurements (approx. 780$~$nm to 820$~$nm). The suggested sQFTIR protocol eliminates the need for optical delay scanning and leverages inherent mapping between the related domains. In the theoretical section, we evaluate the intrinsic signal-to-noise advantage of the proposed method over conventional scan-based time-domain measurements; a difference of 26.8 dB (factor of 21.8) is demonstrated. Building on the enhanced sensitivity of the scheme, we demonstrate rapid sQFTIR-based hyperspectral imaging with a spatial resolution of 12.3$~\mu$m and a spectral resolution down to 8$~$cm$^{-1}$. Hyperspectral mapping of human colon tissue, microplastics, and multilayer polymer samples composed of polypropylene and ethylene vinyl alcohol yield high-quality single-pixel spectra with acquisition times down to 10$~$ms.
What Do They See? Interpreting Complex Road Scenarios Through the Eyes of Vision-Language-Action Models for Safe and Trustworthy Autonomous Vehicle Learning
arXiv:2607.16938v1 Announce Type: new Abstract: End-to-end autonomous driving models are now able to navigate complex road scenarios, mapping raw sensor observations directly to observed paths for open-loop evaluation and often effective driving in closed-loop evaluation. Yet the internal logic of these safety-critical systems remains largely opaque, due to the complexity of traffic scenes. We propose a counterfactual ablation framework called Counterfactual Vision Action Analysis (CVAA) that systematically removes individual detected objects from front-camera images using photorealistic generative inpainting to prepare counterfactual sets to evaluate the difference in the model's response. This isolates the causal effect of each object's presence on the model's planning behaviour. Applied to the Alpamayo 1 trajectory predictor across 210 nuScenes driving scenes, we create a dataset Counter -nuScenes, using which we see that vehicles and pedestrians within the model's 'path' dominate causal influence as expected, while traffic lights, as expected, exert disproportionate effect relative to their image footprint. However, we also find cases where the model responds strongly to objects a human driver would consider irrelevant. This brings forth a deeper question: does the model itself view the scene as a sum of individual objects influencing the outcome, or does it encode an entirely different set of internal features that do not correspond to human-legible scene elements? To further understand this, we compare intermediate representations of original and inpainted image pairs using mechanistic interpretability techniques and examine the effect of the removal through the various model layers. Together, these two stages offer a path from behavioral auditing to representational understanding, creating explainable driving systems and solidifying human-AI trust.
Denoising Models Develop Human-Like Perceptual Illusion Representations Across Architectures
arXiv:2607.17138v1 Announce Type: new Abstract: Deep neural networks trained on natural images are shown to produce outputs consistent with human observers for brightness illusions. While this phenomenon has been documented across architectures, all evidence, to date, is measured at the output level: restored pixels, decoded trajectories, or classification decisions. Whether these models actually represent illusions internally, and if so where and how, remains unknown. We show that denoising models develop illusion-sensitive representations at specific internal layers, across varied architectures. Specifically, we identify the layers and channels that discriminate illusory from physically matched control regions. We show that the denoising objective is a more important driver of the effect than the architecture. On domain-appropriate stimuli, these activations track a validated psychophysical model of human brightness perception (FLODOG; Spearman $\rho \geq 0.70$) and scale monotonically with parametric illusion strength. Leveraging these findings, we provide causal evidence via channel ablation showing that illusion-sensitive channels specifically and substantially affect the internal signal. Yet injecting these representations into the generation pipeline produces no measurable pixel shift across all tested architectures; we term such representations perceptual phantoms: active in internal processing yet invisible to any output-based evaluation. While related internal-output dissociations have been characterized in language models, this is the first such characterization for perceptual representations in denoising vision models.
Audio Cross Verification Using Dual Alignment Likelihood Ratio Test
arXiv:2607.18190v1 Announce Type: new Abstract: This paper explores a way to verify that audio has not been maliciously tampered in a specific context: short viral videos taken from news recordings. Rather than trying to detect artifacts of tampering (internal inconsistency), we focus on positively verifying a query against a trusted source such as a news recording (external consistency). We propose a method for cross verifying a short audio query against a reference recording from which it was taken. Our approach is to define two hypotheses (non-tampered vs tampered), calculate the most likely alignment between query and reference for each hypothesis, and then perform a likelihood ratio test on the two alignments. We show that this method is fast to compute, much more robust than using MFCC features with Euclidean distance, and has the key benefit of explainability. Our cross verification approach provides an alternative perspective and complementary tool to existing tampering detection methods.
Bridging the Information Gap: Semantic Densification and Hindsight Distillation for Cold-Start Prediction
arXiv:2607.17070v1 Announce Type: new Abstract: New-user cold-start is a critical bottleneck for e-commerce platforms: predicting user lifetime value (LTV) and conversion rate (CVR) for users with sparse interaction history. Two prior directions -- LLM-based semantic augmentation and learning using privileged information (LUPI) -- each face a key limitation. First, LLM augmentation produces unstructured rationales that are noisy and hard to operationalize in production. Second, naive student-teacher distillation can be brittle due to an information gap between the privileged teacher and the sparse student; moreover, this gap is heterogeneous across users. We propose SemRaD, a Semantic Reasoning-aware Distillation framework addressing both limitations. First, a Structured Semantic Reasoning Pipeline replaces free-form rationales with a structured schema built via a discover-curate-audit workflow, producing per user a Densified Semantic Profile (consumed by the deployed student via a Semantic-Gated Encoder that focuses on the most informative dimensions) and a Hindsight Distillation Target reconciled from pre- and post-conversion reasoning (used only at training). Second, to bridge this gap and handle its heterogeneity, a Hindsight-Aware Distillation Network transfers privileged knowledge via the hindsight target, with Distillation Experts improving transfer under per-user variability. On a large-scale industrial dataset, SemRaD lifts +1.9% LTV (Gini) and +1.0% CVR (AUROC) over a production-grade base; a four-week online A/B at Keeta confirms +1.0% LTV / +0.43% CVR. SemRaD also matches the production system's LTV using only 9% of the training data while improving CVR by 0.8%.
DRNOISE: Benchmarking Deep Research Agents in Misleading Evidence Environments
arXiv:2607.17291v1 Announce Type: new Abstract: Deep research agents increasingly operate over the open web, where relevant records coexist with redundant summaries, outdated reports, and misleading documents. Existing evaluations offer limited insight into whether agents preserve sound evidential standards when an ordinary-looking false document is deliberately seeded into a searchable environment and offers a direct shortcut to a conflicting answer. We introduce DRNOISE, a 100-task benchmark for answer recovery under misleading evidence. Each task has a unique gold answer supported by two corroborating indirect record chains; the paired noisy condition adds one plausible document that states a conflicting answer directly. The benchmark spans ten families of evidence operations. Across agents with strong clean-task performance, this single intervention causes 66-88 percentage-point accuracy drops. Trace analyses identify verification inertia as the dominant failure mode: agents often retrieve truthful records but stop before completing and reconciling the evidence chain, instead deferring to the answer-like document. Generic verification prompts reduce but do not close this gap. The setting is especially relevant to open-web deployment, where plausible falsehoods arrive through ordinary-looking pages rather than explicit attacks. Reliable deep research therefore requires more than retrieval and citation; it requires active reconciliation of direct claims with record-level evidence.