Forskningsradar

Science Journals

Peer-reviewade publikationer — 53899 artiklar

Poison to Detect: Detection of Targeted Overfitting in Federated Learning
arXiv:2509.11974v2 Announce Type: replace Abstract: Federated Learning (FL) enables collaborative model training among clients without centralising data, making it a widely adopted privacy-enhancing technology (PET). Despite its privacy benefits, FL remains vulnerable to orchestrator-driven privacy attacks. In this paper, we study an underexplored threat in which a dishonest orchestrator intentionally manipulates the aggregation process to induce targeted overfitting in local models of specific clients. Although prior work focuses on reducing information leakage during training, we emphasise early client-side detection of targeted overfitting, allowing clients to disengage before significant harm occurs. To this end, we propose three detection techniques -- label flipping, backdoor trigger injection, and model fingerprinting -- which enable clients to verify the integrity of the global aggregation. We evaluated our methods across multiple datasets and attack scenarios. In single-client attacks, all three methods detect orchestrator-induced overfitting within 1-2 training rounds with F1 scores up to 0.7. Scalability experiments further show that detection effectiveness is influenced by cohort composition and method parameters. These results demonstrate that client-side integrity testing can provide early, effective, and scalable detection, supporting safer deployment of FL systems.
Think at 5 Hz, Act at 20 Hz: Asynchronous Fast-Slow Vision-Language-Action Inference for Closed-Loop Driving
arXiv:2607.15621v1 Announce Type: new Abstract: Large language models bring instruction following and scene reasoning to end-to-end driving, but their inference latency collides with the control rate a vehicle requires. Existing closed-loop agents hide this gap by invoking the model on alternate simulation ticks and replaying the previous command in between, so half of all control outputs ignore the newest observations. We present a fast-slow architecture that removes this compromise. A frozen 7B vision-language backbone acts as the slow system, digesting navigation instructions and visual history at low frequency while exposing its per-layer key-value cache as a standing representation of the scene. A lightweight action expert acts as the fast system, attending to this cache and to the current camera frame at every simulation tick to regress waypoints in a single forward pass. Since the cache lags behind the world at deployment, we train the expert under randomized staleness, aligning training with asynchronous execution. On LangAuto-Short routes in CARLA, our system produces fresh control at every 50 ms simulation tick and lifts route completion from 37.0 to 94.0 over the frame-skipping baseline. A frame-skip ablation with the same expert separates the two factors at work: the expert raises the driving score on its own, while per-tick freshness raises completion from 82.1 to 94.0 and cuts red-light violations by a third. Trained on a single town, the expert transfers zero-shot to two unseen towns, holding 84-94% route completion where the baseline reaches 31-41%. It reduces open-loop waypoint error by nearly a factor of four compared to the backbone's own action head, at a per-tick model cost of 32 ms that is independent of history length on a single consumer GPU.
Characterizing Phishing Pages by JavaScript Capabilities
arXiv:2509.13186v2 Announce Type: replace Abstract: Phishers achieve large-scale attacks by using ready-to-deploy phishing websites (phishing kits) to rapidly launch campaigns that leverage specific data exfiltration, evasion, or mimicry techniques. In contrast, researchers and defenders continue to rely on manual analysis to identify features for kit fingerprinting. In this paper, we examine the link between a page's client-side behavior and the underlying phishing kit used, enabling automated aggregation of phishing pages. Our key insight is that client-side techniques make heavy use of browser APIs, which, in turn, differentiate underlying kits based on their feature sets. Using an instrumented browser and a URL fuzzing utility, we collected traces from 1,328,917 pages and recovered kit archives for 4,180 pages between August 2023 and January 2025. For the labeled subset, we find that clustering based on the set of browser APIs executed yields 98% accuracy in grouping them by the underlying kit. We also find that 434,495 phishing pages execute enough browser APIs to cluster into 9,306 clusters, compressing multi-lingual phishing pages across various domains into a single cluster. Our findings show that analysts and researchers can leverage the complexity of client-side phishing code to track phishers' kit deployments in the wild.
Comparative Field Deployment of Reinforcement Learning and Model Predictive Control for Residential HVAC
arXiv:2510.01475v2 Announce Type: replace Abstract: Model Predictive Control (MPC) has demonstrated significant performance improvements over today's control methods for residential Heating, Ventilation, and Air Conditioning (HVAC), but deploying MPC often requires substantial engineering effort. Reinforcement Learning (RL) may offer comparable performance with easier deployment, but its practical application for residential HVAC remains largely undemonstrated, leaving open questions related to occupant comfort and data requirements. To investigate these issues, we deployed one MPC variant and one model-based RL variant for one month each in an occupied house in a cold climate. The controllers adjusted an air-to-air heat pump's thermostat temperature setpoint based on measurements of the indoor temperature and the electric power used for heating. Relative to constant-setpoint operation, MPC saved 18.1\% (95\% confidence interval: 4.4 to 30.9\%) of weather-normalized heat pump energy and RL saved 20.9\% (2.6 to 38.3\%). MPC maintained acceptable occupant comfort. RL kept the house cooler, particularly during an initial adaptation phase, leading to three reports of occupant discomfort. The two algorithms had similar data requirements. We estimate that for a fresh deployment in another house, RL would take about one-third less engineering effort than MPC. While RL reduces deployment effort, it faces difficulties related to safe controller initialization and to mismatches between the modeled and true state and action spaces.
Relativistic Scaling and Magnetization-Current Feedback in Stern Gerlach-Modified Pair-Plasma Reconnection: SpinPIC2D Validation and Nonlinear Regimes
arXiv:2607.15921v1 Announce Type: new Abstract: We investigate the relativistic scaling and electromagnetic feedback of Stern--Gerlach (SG) force driven spin transport in pair-plasma reconnection with SpinPIC2D. The model advances relativistic proper momentum and magnetic BMT spin precession, applies the SG force, deposits spin magnetization, and includes $\mathbf J_M=\nabla\times\mathbf M$ in Ampere's law. In a weak-seed scan at fixed $\gamma_{\rm tr}=2$, the normalized global magnetic flux-growth remains near the classical control-run for $\Xi\le0.1$, is $0.016$ at $\Xi=0.4$, and reaches approximately $0.12$ and $0.25$ at $\Xi=0.7$ and 1, respectively over $3\le t/\tau_{\rm sp}\le7$. Because $\partial/\partial y=0$ in the 2.5-D geometry, the direct $y$-directed SG term vanishes and the enhancement is indirect: sheet-normal SG sorting restructures branch-resolved electron and positron velocity distributions which results in changes in pressure moments and generates a layered magnetization current. Along a fixed-$\chi_{\rm sim}$ family, increasing $\gamma_{\rm tr}$ reduces $\Xi$ and suppresses branch sorting, whereas the matched-control flux-growth enhancement remains positive for $\gamma_{\rm tr}=2,3,5$. Retuning $\chi_{\rm sim}$ to hold $\Xi=1$ does not preserve nonlinear similarity: both the coupling and $J_{M,y}$ increase with $\gamma_{\rm tr}$, and the $\gamma_{\rm tr}=5$ case develops a multi-X-line state. Thus $\Xi$ orders the onset of SG-modified reconnection, while the nonlinear response also depends on the absolute spin coupling and magnetization-current amplitude.
Revisiting Real-Time Interval and Throughput Maximization
arXiv:2607.16163v1 Announce Type: new Abstract: Job throughput maximization is the central maximization problem in scheduling. Interval scheduling is the special case of throughput maximization when jobs are intervals and therefore there is no slack available in which to schedule a job. It is interesting to know to what extent results for interval scheduling can be extended to the more general throughput problem in the real-time model. For the unweighted and proportionally weighted throughput problem (where the weight or value $w_i$ of a job $J_i$ is its processing time $p_i$), there are constant competitive real-time scheduling algorithms using preemption with restarting. More generally, the result for proportionally weighted interval scheduling can be extended to C-Benevolent weight functions. We also introduce a new real-time model in which jobs are announced before the actual release time of a job. We show that with sufficient advance notice, we can obtain a constant competitive ratio for proportionally weighted throughput {\it without any preemption}. However, this advance notice result does not extend to arbitrary C-Benevolent and D-Benevolent weight functions. Finally, we show that unlike interval scheduling, unweighted throughput using preemption with revoking admits no constant competitive ratio when the number of distinct processing times is unrestricted. More precisely, for instances with at most $k$ distinct processing times, we give a lower bound of $1/(k+1)$ and a deterministic $1/(2k)$-competitive algorithm.
Multi-marginal temporal Schr\"odinger Bridge Matching from unpaired data
arXiv:2510.01894v3 Announce Type: replace Abstract: Many natural dynamic processes -- such as in vivo cellular differentiation or disease progression -- can only be observed through the lens of static sample snapshots. While challenging, reconstructing their temporal evolution to decipher underlying dynamic properties is of major interest to scientific research. Existing approaches enable data transport along a temporal axis but are poorly scalable in high dimension and require restrictive assumptions to be met. To address these issues, we propose Multi-Marginal temporal Schr\"odinger Bridge Matching (MMtSBM) from unpaired data, extending the theoretical guarantees and empirical efficiency of Diffusion Schr\"odinger Bridge Matching (arXiv:2303.16852) by deriving the Iterative Markovian Fitting algorithm to multiple marginals in a novel factorized fashion. Experiments show that MMtSBM retains theoretical properties on toy examples, achieves state-of-the-art performance on real-world datasets such as transcriptomic trajectory inference in 100 dimensions, and, for the first time, recovers couplings and dynamics in very high-dimensional image settings. Our work establishes multi-marginal Schr\"odinger bridges as a practical and principled approach for recovering hidden dynamics from static data.
Connectivity Maintenance and Recovery for Multi-Robot Motion Planning
arXiv:2510.03504v3 Announce Type: replace Abstract: Connectivity is crucial in many multi-robot applications, yet balancing connectivity maintenance and fleet traversability in obstacle-rich environments remains challenging. Reactive controllers based on control barrier functions can preserve connectivity when it is initially satisfied, but often struggle with deadlocks in cluttered environments. We propose a real-time B\'ezier-based constrained motion planning algorithm, namely MPC--CLF--CBF, that produces trajectories and control inputs concurrently, subject to high-order control barrier function and control Lyapunov function constraints. Our motion planner supports connectivity-aware navigation in cluttered workspaces and recovers connectivity from initially disconnected configurations and after temporary obstacle-induced separation; it also provides analytic continuous-time derivatives, facilitating its application to agile differentially flat systems such as quadrotors. In simulations with $4$--$12$ robots, it maintains $95.8$--$100\%$ graph-connected time at $20\%$ obstacle density, compared with $48.9$--$61.3\%$ for MPC--CBF, with no observed collisions. We further validate the planner in a physical experiment with $8$ Crazyflie nano-quadrotors.
Be Tangential to Manifold: Discovering Riemannian Metric for Diffusion Models
arXiv:2510.05509v3 Announce Type: replace Abstract: Diffusion models are powerful deep generative models, but unlike classical models, they lack an explicit low-dimensional latent space that parameterizes the data manifold. This absence makes it difficult to perform manifold-aware operations, such as geometrically faithful interpolation or conditional guidance that respects the learned manifold. We propose a training-free Riemannian metric on the noise space, derived from the Jacobian of the score function. The key insight is that the spectral structure of this Jacobian separates tangent and normal directions of the data manifold; our metric leverages this separation to encourage paths to stay tangential to the manifold rather than drift toward high-density regions. To validate that our metric faithfully captures the manifold geometry, we examine it from two complementary angles. First, geodesics under our metric yield perceptually more natural interpolations than existing methods on synthetic, image, and video frame datasets. Second, the tangent-normal decomposition induced by our metric prevents classifier-free guidance from deviating off the manifold, improving generation quality while preserving text-image alignment.
Are Heterogeneous Graph Neural Networks Truly Effective for Node Classification? A Causal Perspective
arXiv:2510.05750v2 Announce Type: replace Abstract: Graph neural networks (GNNs) have achieved remarkable success in node classification. Building on this progress, heterogeneous graph neural networks (HGNNs) integrate relation types and node and edge semantics to leverage heterogeneous information. Causal analysis for HGNNs is advancing rapidly, aiming to separate genuine causal effects from spurious correlations. However, whether HGNNs are intrinsically effective for node classification remains underexamined, and most studies implicitly assume rather than establish this effectiveness. In this work, we examine HGNNs for node classification from two perspectives: model architecture and heterogeneous information. We conduct a systematic reproduction across 21 datasets and 20 baselines, complemented by comprehensive hyperparameter retuning. To further disentangle the source of performance gains, we develop a causal mediation analysis framework that treats the introduction of heterogeneous relation information as the treatment, candidate structural properties as mediators, and node classification performance as the outcome. This framework first screens candidate mediators according to their treatment-induced changes and their associations with performance improvement, and then decomposes the total effect into mediated and direct effects. Our results lead to two conclusions. First, model architecture and complexity have no causal effect on node classification performance. Second, heterogeneous information exerts a positive causal effect primarily through increasing homophily and local-global distribution discrepancy, which makes node classes more distinguishable. The implementation is publicly available at https://github.com/YXNTU/CausalHGNN.
Simultaneous Calibration of Noise Covariance and Kinematics for State Estimation of Legged Robots via Bi-level Optimization
arXiv:2510.11539v5 Announce Type: replace Abstract: Accurate state estimation is critical for legged and aerial robots operating in dynamic, uncertain environments. A key challenge lies in specifying process and measurement noise covariances, which are typically unknown or manually tuned. In this work, we introduce a bi-level optimization framework that jointly calibrates covariance matrices and kinematic parameters in an estimator-in-the-loop manner. The upper level treats noise covariances and model parameters as optimization variables, while the lower level executes a full-information estimator. Differentiating through the estimator allows direct optimization of trajectory-level objectives, resulting in accurate and consistent state estimates. We validate our approach on quadrupedal and humanoid robots, demonstrating significantly improved estimation accuracy and uncertainty calibration compared to hand-tuned baselines. Our method unifies state estimation, sensor, and kinematics calibration into a principled, data-driven framework applicable across diverse robotic platforms.
VTAP Gripper: Synergizing Fingertip Sensing and a Visuo-Tactile Active Palm for Dexterous In-Hand Manipulation
arXiv:2607.15448v1 Announce Type: new Abstract: This paper presents a tactile-reactive gripper that integrates a Visuo-Tactile Active Palm (VTAP) and compliant, reconfigurable fingers equipped with tactile array sensors. The design exploits structured finger-palm synergy and multi-modal perception to achieve both robust grasping and fine manipulation. The actuated bi-modal palm seamlessly combines long-range visual localization with contact-rich tactile feedback, substantially extending the system's manipulation capability. To bridge the embodiment gap between human hand motion and the heterogeneous three-finger structure, we further propose a staged, gesture-conditioned retargeting framework for dexterous teleoperation. Extensive experiments validate the system across a range of challenging tasks: reactive grasping of YCB and fragile objects, in-hand syringe reorientation and plunger actuation, singulation of clustered objects down to 3 mm in diameter, and vision-tactile peg-in-hole insertion. Results demonstrate that high manipulation performance can be achieved through coordinated finger-palm interaction and multi-modal sensing, without resorting to high degrees of freedom anthropomorphic designs. The VTAP gripper and its retargeting framework offer a practical reference architecture for dexterous gripper design, manipulation, and contact-rich data collection in support of learning-based approaches. Project webpage: https://yuhochau.github.io/vtap/.
A framework for realisable data-driven active flow control using model predictive control applied to a simplified truck wake
arXiv:2510.11600v3 Announce Type: replace Abstract: We present a data-driven active flow control framework designed for deployment with few non-intrusive sensors. The method builds upon Artificial Intelligence driven reduced-order predictive models based on Long-Short-Term Memory (LSTM) networks and efficient gradient-based Model Predictive Control (MPC). The model uses only surface-mounted pressure probes to infer the wake state, and is trained entirely offline on a dataset built with open-loop actuations, thus avoiding the complexities of online learning. Sparsification of the sensors needed for control from an initially large set is achieved using SHapley Additive exPlanations (SHAP). A parsimonious set of sensors is then deployed in closed-loop control with MPC. The framework is tested in numerical simulations of a two-dimensional truck model at Reynolds number 500, with pulsed-jet actuators placed in the rear of the truck to control the wake. The resulting LSTM-MPC achieved a drag reduction of 12.8\%.
CHIA: An open-source framework for principled, agentic AI-driven hardware/software co-design research
arXiv:2606.27350v3 Announce Type: replace Abstract: Agentic artificial intelligence shows great promise for radically improving the pace of innovation in hardware/software co-design research across computer architecture, systems, compilers, and VLSI. Thus far, however, applications of AI in these contexts have generally been demonstrated in isolated settings on small-scale problems, due to the difficulty of designing and deploying complex AI-infused hardware and software development workflows. This paper introduces CHIA, an open-source hardware/software co-design framework for agile and principled research on the application of AI to co-design. CHIA treats the productive construction and scalable deployment of the co-design flow itself as a first-class objective. In CHIA, agentic AI-driven hardware and software design flows are expressed as CHIA loops: directed cyclic graphs whose nodes execute various system-on-chip design tools, microarchitectural simulators, software build systems, AI models, evolutionary coding agents, and more. The CHIA library provides node implementations for many popular tools, including Chipyard, gem5, ChampSim, FireSim, Hammer (thus several commercial ASIC CAD tools), Vivado, AlphaEvolve, AdaEvolve, and many others. CHIA also provides a broad set of features to conduct principled science around these flows. These include isolation between AI models and hardware tools, profiling mechanisms, fault-tolerant execution, and reliability at scale across hundreds of heterogeneous systems (CPUs, FPGAs, GPUs, etc., across public cloud/on-prem.). To showcase CHIA, we present five CHIA loops as case studies: (1) automatic RTL-to-gem5 simulator alignment, (2) LLM-driven implementation of microarchitectural features in RTL, (3) agentic, IPC-aware critical path optimization, (4) evolutionary architectural discovery, and (5) maintainer-friendly agentic GitHub issue fixing.
Prediction-Only Distillation in Linear and Logistic Regression
arXiv:2607.15450v1 Announce Type: cross Abstract: Self-distillation (SD) is typically studied when the student is retrained on the teacher's original training inputs. In many practical deployments, however, the labeled training data are no longer available, and one has access only to the trained predictor and fresh unlabeled covariates. We study SD in this prediction-only regime through a fresh-X prediction-mixed scheme: a pure-distilled student is trained on fresh covariates pseudo-labeled by the teacher, and the final predictor is an affine combination of the teacher and student predictions. For ridge regression under proportional asymptotics, we derive deterministic equivalents for the optimally mixed prediction risk under general anisotropic covariance and deterministic signal. We show that this risk is strictly smaller than the teacher risk for almost every pair of teacher and student regularization levels, including when the fresh covariates are out-of-distribution and even when their covariance is isotropic. We further show that the optimal mixing weight cannot be identified from unlabeled data alone, but can be consistently estimated in a single post-training step using a small independent labeled calibration set, without additional model fitting. Finally, for binary logistic regression, we show that prediction mixing can outperform both the teacher and the pure-distilled classifier.
Analysing Moral Bias in Finetuned LLMs through Mechanistic Interpretability
arXiv:2510.12229v3 Announce Type: replace Abstract: Large language models (LLMs) have been shown to internalize human-like biases during finetuning, yet the mechanisms by which these biases manifest remain unclear. In this work, we investigated whether the well-known Knobe effect, a moral bias in intentionality judgements, emerges in finetuned LLMs and whether it can be traced back to specific components of the model. We conducted a Layer-Patching analysis across 3 open-weights LLMs and demonstrated that the bias is not only learned during finetuning but also localized in a specific set of layers. Surprisingly, we found that patching activations from the corresponding pretrained model into just a few critical layers is sufficient to eliminate the effect. Our findings offer new evidence that social biases in LLMs can be interpreted, localized, and mitigated through targeted interventions, without the need for model retraining.
Mixing Configurations for Downstream Prediction
arXiv:2510.19248v2 Announce Type: replace Abstract: Clustering-based features are widely used in machine learning, but most methods must choose a resolution -- a choice that is global, fixed, and ad hoc. Recent work shows that varying the resolution parameter produces only a finite set of structurally stable partitions, known as configurations. Based on this, we introduce Configuration-Mixed Prediction (CMP), a setting where models learn to adaptively weight these configurations per sample for downstream prediction. We propose MixConfig, a plug-and-play feature augmentation module that extracts configurations from any frozen embedding and learns energy-aware mixing weights via a novel selector that jointly reasons about sample context, cluster assignments, and stability statistics. Experiments across tabular, molecular, vision, and text domains demonstrate consistent improvements over single-resolution and static baselines across diverse predictor architectures, with gains particularly pronounced in low-data regimes.
Revisiting the phenomenon of bouncing of inertial particles crossing density stratified interfaces
arXiv:2510.21971v3 Announce Type: replace Abstract: Inertial spheres settling through sharp density interfaces can arrest, reverse direction, and resume descent, a phenomenon known as bouncing. Using synchronized particle image velocimetry and tracking in water-salt and water-glycerol stratifications, we demonstrate that bouncing is the dynamic response of a coupled sphere-fluid composite. As the sphere crosses the interface, it entrains a boundary layer of lighter fluid, creating a transient buoyant wake. We formalize this mechanism into a phenomenological dynamic model that couples the momentum of the sphere with the entrainment and detachment of the wake. Evaluating the stationary points of this system yields a criterion that classifies trajectory archetypes (smooth crossing, deep minima, and bouncing) across different fluid regimes. We identify a dual role of viscosity, which is often overlooked by density-only models: it acts kinematically to thicken the boundary layer and increase the entrained wake volume, and dynamically to alter the drag-to-weight balance. Furthermore, we describe the spatial dynamics of the crossing: inertia-dominated spheres penetrate further into the lower fluid before arresting due to a longer wake-detachment length, whereas buoyancy-dominated spheres arrest closer to the interface. Finally, we show that the retention time is governed by the buoyancy-driven detachment of the entrained film. By normalizing the measured retention times with a characteristic detachment timescale, we collapse the data from different viscosity regimes onto a single curve. These physical insights allow the prediction of trajectory archetype, deceleration depth, and retention time from bulk properties.
A cubical formalisation of topos causal models: intervention, sheaf gluing, and the intuitionistic do-calculus
arXiv:2607.15629v1 Announce Type: new Abstract: Topos causal models recast causal inference inside a topos: a causal world is a presheaf, an intervention is a characteristic map into the subobject classifier, and reasoning is carried out in the intuitionistic internal language. We give the first machine-checked account of this 1-topos core, in Cubical Agda, over a previously verified probability monad and do-calculus. We build the classifier of sieves and realise the intervention $\mathrm{do}(X := x_0)$ as a characteristic map with its classification theorem; prove the sheaf gluing of independent mechanisms, which the source asserts but never proves; and machine-check the Kripke-Joyal forcing clauses of the internal language. In the modal layer we find and repair a gap: the three standard Lawvere-Tierney axioms do not force a closure operator. With the missing law restored, we exhibit the double-negation topology as a concrete instance and show that interventions and Pearl's rules are stable under every topology. Transportability of a counterfactual across a cover of regimes then coincides with this $j$-stability, understood as invariance across the cover. We further add a phenomenon the programme does not consider: a machine-checked contextuality obstruction, where pairwise-consistent local data admit no global model. The development assumes no axioms and typechecks under Agda's --safe flag, with the ordered field discharged concretely at $\mathbb{Q}$; the scope is the presheaf (1-topos) fragment, with type-level sheafification and the directed lift left to future work.
On the Structure of Address in Multi-Party Dialogue: From Discrete Labels to Continuous Levels
arXiv:2607.15648v1 Announce Type: new Abstract: In multi-party dialogues between a dialogue system and multiple users, identifying to whom an utterance is addressed is a key challenge. Prior work has typically treated addressee detection as a multi-class classification task, selecting a single label representing an individual participant or the group. This formulation assumes that address is inherently discrete and has primarily been used for predicting turn-taking. In this paper, we revisit this assumption by analyzing address as a continuous phenomenon. Using a multi-party human dialogue corpus annotated by multiple annotators, we construct both binary address labels derived from majority-vote addressee labels and continuous address levels inferred from annotator judgments using a latent-variable model. We then examine how these representations relate to turn-taking as well as listener behaviors, including gaze and backchannels. Our results show that, in addition to turn-taking, both gaze and backchannels are associated with address. Furthermore, models using continuous address levels achieve better predictive fit than those using discrete labels, suggesting that address may exhibit graded structure. Finally, we discuss the future directions of addressee detection research based on the findings of this study.
Distributional Matching for Vector Quantization: A Unified Theoretical and Empirical Framework
arXiv:2607.15933v1 Announce Type: new Abstract: The effectiveness of modern visual representation learning and autoregressive models critically depends on vector quantization (VQ), which discretizes continuous feature representations using a learnable codebook. Despite its widespread use, existing VQ methods often suffer from training instability and codebook collapse, arising from gradient mismatch induced by the straight-through estimator and the under-utilization of code vectors. In this work, we show that both issues can be traced to a fundamental mismatch between the distributions of feature vectors and code vectors, leading to inefficient representation and information loss. Building on this observation, we propose a distributional matching framework for vector quantization. We introduce principled criteria for desirable VQ behavior and demonstrate through theoretical analysis and empirical evaluation that aligning feature and code vector distributions provides a unifying mechanism for mitigating training instability and codebook collapse. We instantiate this framework using a Wasserstein-based objective with an efficient closed-form under a mild Gaussian approximation, and further show that a nonparametric alternative based on maximum mean discrepancy yields comparable performance. Extensive experiments on visual tokenization benchmarks support the effectiveness and robustness of the proposed approach.
Scalable Open-Source Visuotactile Sensor for 6-Axis Contact Wrench Estimation in Tensegrity Robots
arXiv:2607.15633v1 Announce Type: new Abstract: This paper presents a scalable, open-source visuotactile sensing system for tensegrity robots that enables six-axis wrench estimation and contact detection. The proposed endcap sensor integrates an elastomeric shell, a 3D-printed thermoplastic polyurethane (TPU) interface, and a rigid base housing an embedded camera and LED illumination ring. A novel gyroid-infill bonding technique is introduced to form a durable elastomer-TPU interface without adhesives, yielding a lightweight and modular design compatible with large-scale tensegrity structures. A tactile-to-wrench neural network maps shear vector fields to six-dimensional force and torque measurements. Experimental results demonstrate accurate and stable wrench estimation with a mean squared error (MSE) of 0.1531 on static validation data and out-of-domain generalization under dynamic motion. Furthermore, full-system integration on a 12 kg tensegrity robot confirms the sensor's ability to reliably identify ground contacts. The system substantially improves the practicality of tactile feedback for tensegrity robots, offering a low-cost, reproducible, and physically interpretable pathway toward contact-aware proprioception and state estimation. Open source files are available at \href{https://github.com/Jonathan-Twz/tensegrity-gelfoot}{github.com/Jonathan-Twz/tensegrity-gelfoot}
Before the Action: Benchmarking LLMs on Prospective Hypothesis Discovery
arXiv:2607.15766v1 Announce Type: new Abstract: Large language models (LLMs) excel at answering pre-specified questions, yet their ability to navigate the open-ended, pre-conclusion stage of discovery remains largely unmeasured. We introduce Prospective Hypothesis Discovery (PHD), which asks models to autonomously construct grounded, discriminative, and testable hypothesis spaces from inconclusive evidence, including anomalous observations and fragmented records, to guide subsequent investigation. To evaluate this capability, we introduce HypoArena, comprising HypoData, a benchmark of 988 cases across six scientific and analytical domains, and HypoEval, an evaluation framework for open-ended hypothesis sets. To construct HypoData at scale, we propose Retrospective Context Regression, a Forge--Audit pipeline that reconstructs pre-conclusion contexts from completed expert documents by removing explicit conclusions, target hypotheses, and retrospective causal attributions while preserving the factual substrate. Because PHD admits multiple valid outputs, HypoEval combines bidirectional pairwise judgments with Bradley--Terry--Davidson aggregation for ranking and six-dimensional rubric scoring for diagnosis. Experiments on 15 frontier LLMs reveal clear capability stratification and model-dependent effects of structured analytical skills, with gains for several lower-performing models on HypoArena but regressions for other systems, including a top-performing model. Compared with absolute rubric scoring, arena evaluation resolves finer-grained differences among models, with aggregated rankings showing strong agreement with human experts and an independent judge. Together, these results support treating PHD as a distinct target for evaluating how LLMs formulate investigative directions when final conclusions are withheld. Our code and data are publicly available at github.com/SKYLENAGE-AI/HypoArena and github.com/SKYLENAGE-AI/HypoArena.
A Projected Drift-Randomized Milstein Method for SDEs with Non-differentiable and Super-linear Drift Coefficients
arXiv:2607.15934v1 Announce Type: new Abstract: We propose a projected drift-randomized Milstein (PRM) method for stochastic differ ential equations with non-differentiable and super-linearly growing drift coefficients. The method extends the randomized Milstein approach beyond the globally Lipschitz setting by incorporating a drift projection into the randomized quadrature approximation. Moreover, unlike existing first-order Milstein-type methods for SDEs with super-linearly growing drift coefficients, the proposed method does not require spatial differentiability of the drift coefficient. Under suitable polynomial Lipschitz and one-sided Lipschitz conditions on the drift, together with standard regularity assumptions on the diffusion, we establish a one-step mean-square stability estimate and derive the required local residual bounds. These esti mates yield first-order strong convergence of the PRM method in the L2-sense. Numerical experiments confirm the theoretical convergence rate and demonstrate the applicability of the method to SDEs with non-differentiable and super-linearly growing drifts.
Vortex formation around islands in random waves
arXiv:2607.15938v1 Announce Type: new Abstract: Wave vortices are fundamental topological features of interference fields, occurring at nodal points where the wave amplitude vanishes. A distinct class of vortices can instead form around it islands or `holes' in two-dimensional wavefields, where the wave intensity remains finite and may even peak at the boundary. In particular, such vortices occur in M2 ocean tides around New Zealand, Madagascar, Iceland, and Svalbard, yet the conditions governing their appearance have remained elusive. Here we develop a statistical theory of vortices around islands in random two-dimensional wavefields, with and without the Coriolis effect, and test it experimentally. We determine the probabilities of vortices with different topological charges as functions of island size and Coriolis parameter. We find that island-bound vortices emerge with unexpectedly high probability, approaching 50% in non-rotating systems and nearly 100% in rotating systems. Moreover, for a broad range of parameters, the presence of a subwavelength island dramatically enhances vortex formation compared with homogeneous random wavefields. Our results explain the formation of tidal vortices around ocean islands of particular sizes (~0.1 of the characteristic wavelength) and establish a general mechanism for generating localized high-intensity vortices around defects in diverse wave systems, from water waves to nanophotonic structures.