Researchers Create First Large Multilingual Dataset to Study How Writing Style Affects AI Language Models
Scientists have built a new annotated dataset covering 38 languages that identifies 17 different writing genres—from news to social media—addressing a critical gap in AI training data. The resource could help companies and researchers understand how text type influences AI performance, ultimately improving machine translation and text analysis tools across languages.
Originaltitel: UD-MULTIGENRE: a UD-Based Dataset Enriched with Instance-Level Genre Annotations
<p>Prior research on the impact of genre on cross-lingual dependency parsing has suggested that genre is an important signal. However, these studies suffer from a scarcity of reliable data for multiple genres and languages. While Universal Dependencies (UD), the only available large-scale resource for cross-lingual dependency parsing, contains data from diverse genres, the documentation of genre labels is missing, and there are multiple inconsistencies. This makes studies of the impact of genres difficult to design. To address this, we present a new dataset, UD-MULTIGENRE, where 17 genres are defined and instance-level annotations of these are applied to a subset of UD data, covering 38 languages. It provides a rich ground for research related to text genre from a multilingual perspective. Utilizing this dataset, we can overcome the data shortage that hindered previous research and reproduce experiments from earlier studies with an improved setup. We revisit a previous study that used genre-based clusters and show that the clusters for most target genres provide a mix of genres. We compare training data selection based on clustering and gold genre labels and provide an analysis of the results. The dataset is publicly available. (https://github.com/UppsalaNLP/UD-MULTIGENRE)</p>