arXiv:2406.19291cs.DL
Wikipedia Citations: Reproducible Citation Extraction from Multilingual Wikipedia
Early discovery. Linked by one identifiable commenter. This paper is outside the main ranking; a mention is not an endorsement.
Abstract
Wikipedia is an essential component of the open science ecosystem, yet it is poorly integrated with academic open science initiatives. Wikipedia Citations is a project that focuses on extracting and releasing comprehensive datasets of citations from Wikipedia. A total of 29.3 million citations were extracted from English Wikipedia in May 2020. Following this one-off research project, we designed a reproducible pipeline that can process any given Wikipedia dump in the cloud-based settings. To demonstrate its usability, we extracted 40.6 million citations in February 2023 and 44.7 million citations in February 2024. Furthermore, we equipped the pipeline with an adapted Wikipedia citation template translation module to process multilingual Wikipedia articles in 15 European languages so that they are parsed and mapped into a generic structured citation template. This paper presents our open-source software pipeline to retrieve, classify, and disambiguate citations on demand from a given Wikipedia dump.
Not specific to Wikipedia: https://aarontay.medium.com/3-new-tools-to-try-for-literatur... https://archive.is/Ul13s Specific to Wikipedia: Wikipedia Citations: Reproducible Citation Extraction from Multilingual Wikipedia [2024] https://arxiv.org/abs/2406.19291v1…
aspenmayerView on HNParent context