Forskningsradar

Science Journals

Peer-reviewade publikationer — 49876 artiklar

Regression to the Mean can Explain Saturation of Geomagnetic Storms
arXiv:2201.02137v3 Announce Type: replace Abstract: Extreme space weather events on Earth occur during intervals of strong solar wind driving. The solar wind drives plasma convection and currents in the near-Earth space environment. For low values of the driver, the Earth's response is linear, estimated by parameters such as the polar cap index based on ground magnetometer activity. Curiously, for extreme solar wind driving, the Earth's response appears not to increase beyond a saturation limit. Theorists have advanced a host of explanations for this saturation effect, but there is no consensus. Here, we demonstrate that this saturation is a manifestation of the regression to the mean effect arising from random uncertainty in the timing and magnitude of solar wind measurements. Our results reveal that data analysis underpinning the saturation theories is non-linearly biased, thereby challenging the validity of the theories. Correcting for the uncertainties reveals that the Earth's response to solar wind driving is linear throughout, and that the impact of extreme geomagnetic storms can be twice as large as previously thought. We show that regression to the mean is a fundamental property of the relationship between measurement and the truth, where the truth corresponding to the measurement is closer to the mean. This effect is particularly pronounced for uncertain measurements of extreme values and is likely to manifest across various fields, from extreme climate studies to chronic medical pain.
Beyond Interestingness: Semantic and Context-Aware Natural Language Query Recommendations for Visual Data Analysis
arXiv:2201.04868v3 Announce Type: replace Abstract: Recent advances in large language models (LLMs) have made natural language interfaces (NLIs) widely accessible for data exploration, yet analysts who have a broad analytical objective still face the challenge of decomposing it into effective step-by-step queries, especially over unfamiliar, multi-table relational databases. Rather than generating high-level analytical agendas, we investigate how to augment an NLI with semantic- and context-aware next-step query recommendations that act as analytical scaffolding for relational database exploration. Our approach goes beyond interestingness-only methods by jointly integrating semantic relevance, data interestingness, and context coherence to guide exploration toward coherent, topic-focused analyses and potentially insightful subsets. We evaluate QRec-NLI with NL2SQL benchmarking, LLM-enhanced description validation, agentic comparisons against interestingness-only and LLM-based prompting baselines, and a 12-participant user study. In the agentic comparison, QRec-NLI yields more topically relevant and locally coherent query sequences than both baselines. In the user study against the interestingness-only baseline, it receives stronger ratings for insight-generation support and decision support.
Bridging the Gap between Newton-Raphson Method and Regularized Policy Iteration
arXiv:2310.07211v2 Announce Type: replace Abstract: Regularization is a cornerstone of modern reinforcement learning. Regularized policy iteration (RPI) provides a fundamental scheme for solving regularized Markov decision processes (RMDPs), and the widely used soft actor-critic algorithm arises as a special case when the regularizer is Shannon entropy. Despite its empirical success, the theoretical underpinnings of RPI remain unclear. In this paper, we address this gap by proving that RPI is formally equivalent to the standard Newton-Raphson method applied to the Bellman equation smoothed by strongly convex regularizers. This equivalence enables a unified convergence analysis of existing methods and supports the development of accelerated algorithms. We show that RPI enjoys local quadratic convergence; notably, for Shannon entropy, the guarantee is dimension-free. We further study RPI with inexact policy evaluation, establishing its equivalence to an inexact Newton method in which each Newton step is solved via truncated iterations, and derive an asymptotic linear convergence rate of $\gamma^{M}$, where $M$ denotes the number of operator steps used in policy evaluation. Finally, motivated by higher-order Newton schemes, we propose a new algorithm for RMDPs that achieves third-order local convergence. Numerical experiments corroborate our theory and demonstrate the practical advantages of the proposed algorithm. Overall, our results advance the theoretical understanding of regularization in reinforcement learning and suggest new directions for efficient algorithm design.
Seeing Through Uncertainty: Free-Energy-Inspired Real-Time Adaptation for Robust Visual Navigation
arXiv:2403.01977v5 Announce Type: replace Abstract: Navigation in the natural world is a feat of adaptive inference, where biological organisms maintain goal-directed behaviour despite noisy and incomplete sensory streams. Central to this ability is the Free Energy Principle (FEP), which posits that perception is a generative process where the brain minimises Variational Free Energy (VFE) to maintain accurate internal models of the world. While Deep Neural Networks (DNNs) have served as powerful analogues for biological brains, they typically lack the real-time plasticity required to handle abrupt sensory shifts. We introduce FEP-Nav, a biologically inspired framework for real-time perceptual adaptation in robust visual navigation. Motivated by the decomposition of VFE into prediction error and Bayesian surprise, FEP-Nav combines a Top-down Decoder, which provides an internal expectation of uncorrupted sensory input, with Adaptive Normalisation, which adjusts shifted feature distributions toward prior statistics. We interpret reconstruction and normalisation as approximate mechanisms for reducing the corresponding VFE-related terms during inference without gradient-based updates. Experiments across simulated and real-world visual corruptions show that FEP-Nav restores performance lost under visual corruption, outperforming non-adaptive baselines and strong adaptive methods. These results suggest that variational principles can provide a useful design perspective for robust autonomous behaviour under degraded sensory conditions.
An inflated dynamic Laplacian to track the emergence and disappearance of semi-material coherent sets
arXiv:2403.10360v2 Announce Type: replace Abstract: Lagrangian methods continue to stand at the forefront of the analysis of time-dependent dynamical systems. Most Lagrangian methods have criteria that must be fulfilled by trajectories as they are followed throughout a given finite flow duration. This key strength of Lagrangian methods can also be a limitation in more complex evolving environments. It places a high importance on selecting a time window that produces useful results, and these results may vary significantly with changes in the flow duration. We show how to overcome this drawback in the tracking of coherent flow features. Finite-time coherent sets (FTCS) are material objects that strongly resist mixing in complicated nonlinear flows. Like other materially coherent objects, by definition they must retain their coherence properties throughout the specified flow duration. Recent work [Froyland and Koltai, CPAM, 2023] introduced the notion of semi-material FTCS, whereby a balance is struck between the material nature and the coherence properties of FTCS. This balance provides the flexibility for FTCS to come and go, merge and separate, or undergo other changes as the governing unsteady flow experiences dramatic shifts. The purpose of this work is to illustrate the utility of the inflated dynamic Laplacian introduced in [Froyland and Koltai, CPAM, 2023] in a range of dynamical systems that are challenging to analyse by standard Lagrangian means, and to provide an efficient meshfree numerical approach for the discretisation of the inflated dynamic Laplacian.
A Fast Confirmation Rule for the Ethereum Consensus Protocol
arXiv:2405.00549v4 Announce Type: replace Abstract: A Confirmation Rule is an algorithm run by network nodes to determine whether a block will remain permanently in the canonical chain. The only Confirmation Rule currently available in Ethereum's consensus protocol, Gasper, is FFG finalization. While it tolerates asynchronous network conditions, it is slow: in the best case, a transaction takes 13 to 19 minutes to confirm, depending on when it is submitted. We devise a Fast Confirmation Rule (FCR) for Gasper that, under synchrony and the assumptions stated in this paper, achieves a best-case confirmation time of 12 seconds, a single slot, providing an order-of-magnitude improvement over FFG finalization. The rule is complementary to finalization: users who trust synchrony obtain fast confirmations, while finalization remains available as a fallback that tolerates asynchrony. Gasper is an ebb-and-flow protocol: it combines LMD-GHOST, a fork-choice rule providing fast progress under synchrony, with FFG-Casper, a finality gadget providing finality under partial synchrony. The main technical difficulty is to reason jointly about these two components, so that a block confirmed by LMD-GHOST cannot be filtered out by FFG-Casper's rules. We prove that the rule satisfies both safety, confirmed blocks remain canonical, and monotonicity, a confirmed block remains confirmed at all future times.
Quasi-Monte Carlo for Bayesian design of experiment problems governed by parametric PDEs
arXiv:2405.03529v5 Announce Type: replace Abstract: This paper contributes to the study of optimal experimental design for Bayesian inverse problems governed by partial differential equations (PDEs). We derive estimates for the parametric regularity of multivariate double integration problems over high-dimensional parameter and data domains arising in Bayesian optimal design problems. We provide a detailed analysis for these double integration problems using two approaches: a full tensor product and a sparse tensor product combination of quasi-Monte Carlo (QMC) cubature rules over the parameter and data domains. Specifically, we show that the latter approach significantly improves the convergence rate, exhibiting performance comparable to that of QMC integration of a single high-dimensional integral. Furthermore, we numerically verify the predicted convergence rates for an elliptic PDE problem with an unknown diffusion coefficient in two spatial dimensions, offering empirical evidence supporting the theoretical results and highlighting practical applicability.
OGM-CBF: Occupancy Grid Map-based Control Barrier Function for Safe Mobile Robot Control with Memory of out of View Obstacles
arXiv:2405.10703v5 Announce Type: replace Abstract: Safe control in unknown environments is a key challenge in mobile robotics. Control Barrier Functions (CBFs) provide a principled framework for guaranteeing safety constraint satisfaction. State-of-the-art CBF approaches assume either known environments with predefined obstacles, or rely only on obstacles currently within the robot's Field of View (FoV). However, practical robots in a priori unknown environments can observe their surroundings only partially, and therefore can violate safety due to limited FoV, sensor range, or occlusion. This paper incorporates the memory of previously observed obstacles of arbitrary shape that have left the robot's FoV into CBF-based safe control. In particular, we couple the Signed Distance Function (SDF)-based CBF formulation to an occupancy grid map built online during the system's operation. Furthermore, the lack of steering authority induced by the SDF gradient degeneracy when facing obstacles head-on is addressed by constructing a Gaussian pyramid of the SDF, yielding a multi-level CBF. The efficacy of the proposed approach is evaluated against memory unaware baselines in the CARLA simulator. Moreover, we demonstrate the generalizability of the proposed approach in real deployments on a small warehouse robot and a large, articulated frame steering autonomous wheel loader.
Goal-Oriented Sensor Reporting Scheduling for Non-linear Dynamic System Monitoring
arXiv:2405.20983v3 Announce Type: replace Abstract: Goal-oriented communication (GoC) is a form of semantic communication where the effectiveness of information transmission is measured by its impact on achieving the desired goal. In Internet-of-Things (IoT) networks, GoC can enable sensors to selectively transmit data relevant to the intended goals of the receiver, thereby facilitating timely decision-making, reducing network congestion, and enhancing spectral efficiency. In this paper, we consider an IoT scenario where an edge node polls sensors monitoring the state of a non-linear dynamic system (NLDS) to respond to the queries of several clients. This work delves into the foregoing GoC problem and solution, which we termed goal-oriented scheduling (GoS). The latter utilizes deep reinforcement learning (DRL) with meticulously devised action space, state space, and reward function. A long short-term memory network is used to estimate the inter-query duration and the corresponding estimation standard deviation. This empowers the proposed DRL scheduler to make judicious decisions, even when no queries are posed. Numerical analysis demonstrates that the proposed GoS reduces the mean square error (MSE) of the query responses compared to the benchmark scheduling methods even as the number of clients and DRL action space increase, which proves its scalability. Moreover, this is attained without polling sensors during $70\% - 87\%$ of the testing phase, thus promoting energy efficiency. Lastly, the complexity of the proposed GoS is relatively lower than the benchmark scheduling methods.
Decoupled Alignment for Robust Plug-and-Play Adaptation
arXiv:2406.01514v4 Announce Type: replace Abstract: We introduce a training-free safety enhancement method for aligning large language models (LLMs) without the need for supervised fine-tuning or reinforcement learning from human feedback. Our main idea is to provide a robust plug-and-play approach to prevent shadow alignment when models are adapted to downstream tasks. Specifically, we leverage knowledge distillation to extract alignment signals from well-aligned LLMs and inject them into shadow-aligned models via model fusion, enabling plug-and-play alignment correction. In our methodology, we employ delta debugging to identify the critical components of knowledge necessary for effective distillation. On the harmful question dataset, our method significantly enhances the average defense success rate by approximately 14.42%, reaching as high as 51.39% across 17 influenced LLMs, without compromising performance. Our code is available at https://github.com/NWULIST/DAPA.
Decentralized Reliability Estimation for Low Latency Mixnets
arXiv:2406.06760v3 Announce Type: replace Abstract: Mix networks (mixnets) enable anonymous packet-based communication via multi-hop routing. Measuring the reliability of mix nodes serving as intermediate hops in a way that is decentralized, accurate, public, and compatible with low-latency packet routing, remains, however, a challenge: existing verifiable mixing schemes introduce routing delays ranging from minutes to hours that grow with traffic volume, severely limiting their practicality for large-scale or latency-sensitive applications. We propose a decentralized scheme that provides public reliability estimates for a mixnet's links and nodes without increasing latency for client traffic. The scheme achieves optimal complexity, independent of total network traffic, and enables accurate, low-overhead estimation even at scale. Our approach relies on verifiable measurement packets generated via a novel VRF-based routing primitive. This mechanism produces unforgeable measurement packets indistinguishable from normal traffic, while ensuring that all packet routing choices are consistent with the mixnet's routing policy. Reliability scores are derived from revealed measurement packets. The scheme remains robust under both unreliable and adversarial conditions, producing accurate reliability estimates as long as every honest node has a majority of honest predecessors and successors in the routing graph. We validate our design experimentally, demonstrating its practicality and effectiveness.
QDA-SQL: Questions Enhanced Dialogue Augmentation for Multi-Turn Text-to-SQL
arXiv:2406.10593v3 Announce Type: replace Abstract: Fine-tuning large language models (LLMs) for specific domain tasks has achieved great success in Text-to-SQL tasks. However, these fine-tuned models often face challenges with multi-turn Text-to-SQL tasks caused by ambiguous or unanswerable questions. It is desired to enhance LLMs to handle multiple types of questions in multi-turn Text-to-SQL tasks. To address this, we propose a novel data augmentation method, called QDA-SQL, which generates multiple types of multi-turn Q\&A pairs using LLMs. In QDA-SQL, we introduce a method incorporating validation and correction mechanisms to handle complex multi-turn Text-to-SQL tasks. Experimental results demonstrate that QDA-SQL enables fine-tuned models to exhibit higher performance on SQL statement accuracy and enhances their ability to handle complex, unanswerable questions in multi-turn Text-to-SQL tasks. The generation script and test set are released at https://github.com/mcxiaoxiao/QDA-SQL
Synthetic Light-in-Flight
arXiv:2407.07872v3 Announce Type: replace Abstract: Light-in-flight (LiF) measurements enable the visualization of light paths through arbitrary, volumetric scenes, making light-matter interactions at ultrafast timescales visible. Traditionally, LiF measurements require specialized equipment, such as ultrashort pulse light sources and high-speed electronics, often limited by low spatial resolution. Herein, we introduce a novel computational approach, "Synthetic Light-in-Flight" (SLiF), that overcomes these constraints by relying solely on tunable, continuous wave (CW) lasers and off-the-shelf CMOS cameras. From multiple CW scene measurements at different optical wavelengths, we create multiple "synthetic fields," each at a "synthetic wavelength," which is the beat wave of two respective optical waves. These synthetic fields are robust to speckle and environmental fluctuations, enabling us to combine multiple synthetic fields into a "synthetic light pulse" that sections the volumetric scene at much lower instantaneous peak illumination power than a comparable physical light pulse. We experimentally demonstrate the generation of synthetic pulses with 1 ps-scale width and show that their complex synthetic pulse fields can be freely manipulated in the computer after their acquisition, allowing for spatial and temporal shaping of different sets of pulses from the same set of measurements to maximize the decoded information output for each scene. Finally, we show that the recovered time-of-flight information can be used to characterize physical scene properties, such as depth and refractive indices.
Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunities
arXiv:2408.12548v3 Announce Type: replace Abstract: Machine Learning (ML) has become central to Autonomous Vehicles (AVs), supporting perception, prediction, planning, control, and decision-making in dynamic environments. However, achieving full autonomy in cluttered and complex scenarios, such as intricate intersections, diverse scenes, varied trajectories, and complex missions, remains challenging; moreover, data labeling is still a major bottleneck. These limitations motivate Human-in-the-Loop Machine Learning (HITL-ML), in which human input is incorporated through validation, annotation, task organization, reward design, action correction, preference feedback, and supervisory intervention. To advance safe and ethical autonomy, this paper presents a tutorial survey of HITL-ML for AVs, focusing on Curriculum Learning (CL), Human-in-the-Loop Reinforcement Learning (HITL-RL), Human-in-the-Loop Large Language Models (HITL-LLMs), Active Learning (AL), and ethical principles. We first review CL methods that structure training from simple to complex tasks, covering navigation, path planning, obstacle avoidance, data collection, landing, intersection handling, motion planning, and UAV swarm coordination. We then examine HITL-RL through reward shaping, action injection, demonstrations, preference-based feedback, and interactive learning, emphasizing improved learning efficiency, safer policy exploration, and real-time intervention. Next, we review HITL-LLM through collaboration and oversight and specify key challenges. After that, we discuss AL for perception, anomaly detection, semantic mapping, object detection, vehicle recognition, and security-related classification. Ethical principles are reviewed as technical requirements for transparency, accountability, human oversight, safety, security, regulatory compliance, and reliability of human input.
Evolutionary modelling reveals melodic and harmonic constraints on global scale structure
arXiv:2408.12633v4 Announce Type: replace Abstract: Since antiquity, musical scales have been explained by harmony rather than melody. This view relies on the mathematically designed scales of a few traditions, and was never directly tested. Testing it requires cross-cultural data and a method that judges theories by what they get wrong as well as right. We provide both, modelling scale evolution across 1,314 scales from 96 countries. A Melody model explains the near-universal preference for step-sizes of 1-3 semitones, and matches independent data from melodies, singing, and psychoacoustics. Harmony does far less: it explains the music-theoretic scales, but in those measured from performance it adds only a weak bias towards fourths, fifths, and octaves. Harmony's importance has been overstated, likely due to the historical focus on music-theoretic rather than measured scales. Melody is the primary driver of global scale structure; harmonic constraints are less impactful and mainly reflect musicological theory over musical performance.
What Causes Performance Degradation in Cross-Subject EEG Classification?
arXiv:2410.03057v3 Announce Type: replace Abstract: Cross-subject Electroencephalography (EEG) classification typically achieves significantly lower performance than subject-dependent settings. Although this phenomenon has been widely observed in the literature, the underlying causes have not been systematically studied. In this paper, we design a series of controlled experiments to investigate the mechanisms behind the performance drop in cross-subject EEG classification across different EEG tasks. We show that the performance degradation can generally be attributed to two factors: inter-subject variability and shortcut learning. Specifically, multi-class-per-subject EEG classification tasks, such as motor imagery, emotion recognition, and ERP stimulus classification, are mainly affected by inter-subject variability, whereas single-class-per-subject EEG classification tasks, such as brain disease detection, are primarily influenced by shortcut learning based on subject-specific features. These findings provide new insights into the challenges of cross-subject EEG classification and emphasize the importance of appropriate evaluation protocols in EEG research. The code is available at https://github.com/DL4mHealth/EEG-Cross-Subject.
Formalizing Hyperspaces and Operations on Subsets of Polish Spaces over Abstract Exact Real Numbers
arXiv:2410.13508v2 Announce Type: replace Abstract: Building on our prior work on axiomatization of exact real computation by formalizing nondeterministic first-order partial computations over real and complex numbers in a constructive dependent type theory, we present a framework for certified computation on hyperspaces of subsets by formalizing various higher-order data types and operations. We first define open, closed, compact and overt subsets for generic spaces in an abstract topological way that allows short and elegant proofs with computational content coinciding with standard definitions in computable analysis and constructive mathematics. From these proofs we can extract programs for testing inclusion, overlapping of sets, et cetera. To enhance the efficiency of the extracted programs, we then focus on Polish spaces, where we give more efficient encodings based on metric properties of the space. As various computational properties depend on the continuity of the encoding functions, we introduce a nondeterministic version of a continuity principle which is natural in our formalization and valid under the standard type-2 realizability interpretation. Using this principle we further derive the computational equivalence between the generic and the metric encodings. Our theory is fully implemented in the Coq proof assistant. From proofs in this Coq formalization, we can extract certified programs for error-free operations on subsets. As an application, we provide a function that constructs fractals in Euclidean space, such as the Sierpinski triangle, from iterated function systems using the limit operation. The resulting programs can be used to draw such fractals up to any desired resolution.
When Machine Unlearning Meets Retrieval-Augmented Generation (RAG): Keep Secret or Forget Knowledge?
arXiv:2410.15267v3 Announce Type: replace Abstract: The deployment of large language models (LLMs) like ChatGPT and Gemini has shown their powerful natural language generation capabilities. However, these models can inadvertently learn and retain sensitive information and harmful content during training, raising significant ethical and legal concerns. To address these issues, machine unlearning has been introduced as a potential solution. While existing unlearning methods take into account the specific characteristics of LLMs, they often suffer from high computational demands, limited applicability, or the risk of catastrophic forgetting. To address these limitations, we propose a lightweight behavioral unlearning framework based on Retrieval-Augmented Generation (RAG) technology. By modifying the external knowledge base of RAG, we simulate the effects of forgetting without directly interacting with the unlearned LLM. We approach the construction of unlearned knowledge as a constrained optimization problem, deriving two key components that underpin the effectiveness of RAG-based unlearning. This RAG-based approach is particularly effective for closed-source LLMs, where existing unlearning methods often fail. We evaluate our framework through extensive experiments on both open-source and closed-source models, including ChatGPT, Gemini, Llama-2-7b-chat, and PaLM 2. The results demonstrate that our approach meets five key unlearning criteria: effectiveness, universality, harmlessness, simplicity, and robustness. Meanwhile, this approach can extend to multimodal large language models and LLM-based agents.
Observability-Aware Control for Quadrotor Formation Flight with Range-only Measurement
arXiv:2411.03747v4 Announce Type: replace Abstract: Cooperative Localization is a promising approach to achieving safe quadrotor formation flight through precise positioning via low-cost inter-drone sensors. This paper develops an observability-aware control principle tailored to quadrotor formation flight with range-only inter-drone measurements. The control principle is based on a novel approximation of the local observability Gramian (LOG), which we name the Short-Term Local Observability Gramian (STLOG). The validity of STLOG is established by proving its link to directional estimation precision in nonlinear systems. We propose the Observability Predictive Controller (OPC), a receding-horizon controller that generates optimal inputs to enhance information gain in weakly observable state directions by maximizing the minimum eigenvalue of the STLOG. This reduces the risk of estimator divergence due to the unbounded growth of uncertainty in weakly observed state components. Monte Carlo simulations and flight experiments are conducted with quadrotors in a GNSS-denied ferrying mission, showing that the OPC improves positioning confidence and estimator robustness.
Enhancing a Hierarchical Graph Rewriting Language based on MELL Cut Elimination
arXiv:2411.14802v4 Announce Type: replace Abstract: Hierarchical graph rewriting is a highly expressive computational formalism that manipulates graphs enhanced with box structures for representing hierarchies. It has provided the foundations of various graph-based modeling tools, but the design of high-level declarative languages based on hierarchical graph rewriting is still a challenge. For a solid design choice, well-established formalisms with backgrounds other than graph rewriting would provide useful guidelines. Proof nets of Multiplicative Exponential Linear Logic (MELL) is such a framework because its original formulation of cut elimination is essentially graph rewriting involving box structures, where the so-called promotion boxes with an indefinite number of non-local edges may be cloned, migrated and deleted. This work builds on LMNtal (pronounced "elemental") as a declarative language based on hierarchical (port) graph rewriting, and discusses how it can be extended to support the above operations on promotion boxes of MELL proof nets. LMNtal thus extended turns out to be a practical graph rewriting language that has a strong affinity with MELL proof nets. The language features provided are general enough to encode other well-established models of concurrency. Using the toolchain of LMNtal that provides state-space search and model checking, we implemented cut elimination rules of MELL proof nets in extended LMNtal and demonstrated that the platform could serve as a useful workbench for proof nets.
PERL: Pinyin Enhanced Rephrasing Language Model for Chinese ASR N-best Error Correction
arXiv:2412.03230v3 Announce Type: replace Abstract: Chinese ASR correction is challenging because errors are often \emph{phonetic} (many characters share similar Pinyin) while the correction model must also obey a \emph{length constraint} under noisy N-best hypotheses. Existing approaches either exploit Pinyin only at the prompt/feature level without integrating it into model representations or rely on generative decoding that can drift in length. We propose \textbf{PERL}, a \textbf{constrained rephrasing pipeline} for Chinese N-best ASR correction that (i) predicts the target length and enforces it via mask budgeting, and (ii) fuses \emph{semantic} and \emph{phonetic} (Pinyin) representations through token-wise gates conditioned on sentence semantics. Experiments on Aishell-1 and our new domain N-best benchmark \textbf{DoAD} show that PERL consistently reduces CER (29.11\% on Aishell-1 and up to $\sim$70\% on DoAD) while maintaining low latency. We also provide analyzes of length generalization and phonetic--semantic interactions, showing when PERL relies on phonetic cues versus semantic constraints.
cGAP: Generalized Association Plots with HOMALS-Guided Heatmaps for Visualization of High-Dimensional Categorical Data
arXiv:2607.15018v1 Announce Type: cross Abstract: High-dimensional categorical data arise in genetics, biomedicine, and the social sciences, yet visualization tools for such data remain far less developed than those for continuous variables. Existing methods either scale poorly, rely heavily on low-dimensional displays detached from the original data matrix, or prioritize predictive accuracy over interpretability. To address this gap, we introduce categorical Generalized Association Plots (cGAP), a visualization framework for nominal, ordinal, and binary data that preserves the original data matrix while augmenting it with interpretable geometric structure. cGAP uses Homogeneity Analysis (HOMALS) to embed subjects and category levels in a three-dimensional Euclidean space and maps the embedding to red-green-blue coordinates so that similar patterns receive similar colors. The framework integrates three coordinated views: a HOMALS-guided heatmap of the raw data matrix, a subject proximity matrix, and a variable proximity matrix. Seriation algorithms are then used to reorder rows and columns to reveal coherent clusters, outliers, and local-to-global structure. We also derive barycentric traceability, projection-distortion, and contrast-preservation properties that clarify how embedding geometry is transferred to the display. We demonstrate the versatility of cGAP through applications to student-animal classification data, mammalian dentition profiles, mushroom records from the UCI Machine Learning Repository, and the Clusters of Orthologous Genes database. These examples show that cGAP supports transparent exploratory analysis by maintaining traceability between derived visual structure and the original categorical observations. cGAP provides a full-matrix, heatmap-based visualization environment for investigating complex categorical datasets across scientific domains.
Computing Barycentres of Measures for Generic Transport Costs
arXiv:2501.04016v4 Announce Type: replace Abstract: Wasserstein barycentres represent average distributions between multiple probability measures for the Wasserstein distance. The numerical computation of Wasserstein barycentres is notoriously challenging. A common approach is to use Sinkhorn iterations, where an entropic regularisation term is introduced to make the problem more manageable. Another approach involves using fixed-point methods, akin to those employed for computing Fr\'echet means on manifolds. The convergence of such methods for 2-Wasserstein barycentres, specifically with a quadratic cost function and absolutely continuous measures, was studied by Alvarez-Esteban et al. (2016). In this paper, we delve into the main ideas behind this fixed-point method and explore how it can be generalised to accommodate more diverse transport costs and generic probability measures, thereby extending its applicability to a broader range of problems. We show convergence results for this approach and illustrate its numerical behaviour on several barycentre problems.
A Dichotomy Theorem for Ordinal Ranks in MSO
arXiv:2501.05385v4 Announce Type: replace Abstract: We focus on formulae $\exists X.\, \varphi(\vec{Y}, X)$ of monadic second-order logic over the full binary tree, such that the witness $X$ is a well-founded set. The ordinal rank $\mathrm{rank}(X) < \omega_1$ of such a set $X$ measures its depth and branching structure. We search for the least upper bound for these ranks, and discover the following dichotomy depending on the formula $\varphi$. Let $\mathrm{rank}(\varphi)$ be the minimal ordinal such that, whenever an instance $\vec{Y}$ satisfies the formula, there is a witness $X$ with $\mathrm{rank}(X) \leq \mathrm{rank}(\varphi)$. Then $\mathrm{rank}(\varphi)$ is either strictly smaller than $\omega^2$ or it reaches the maximal possible value $\omega_1$. Moreover, it is decidable which of the cases holds. The result has potential for applications in a variety of ordinal-related problems, in particular it entails a result about the closure ordinal of a fixed-point formula.