A geolocated dataset of German news articles

Kriesch, Lukas; Losacker, Sebastian

A geolocated dataset of German news articles

dc.contributor.author	Kriesch, Lukas
dc.contributor.author	Losacker, Sebastian
dc.date.accessioned	2025-02-10T06:45:46Z
dc.date.available	2025-02-10T06:45:46Z
dc.date.issued	2025-01-30
dc.description.abstract	This data repository consists of a SQLite database with metadata of about 50 million German news articles extracted from the Common Crawl News Dataset. The dataset consists of an SQLite database and a Usearch vector database, which together provide comprehensive data storage and semantic search capabilities. The SQLite database contains structured information about articles and their associated geographic locations, while the vector database enables efficient semantic search through vector representations of the articles. The article titles, texts and excerpts associated with this data can be retrieved directly from Common Crawl and linked to this dataset using the provided IDs. The code for creating this dataset, along with usage tutorials, can be found at: https://github.com/LukasKriesch/CommonCrawlNewsDataSet
dc.description.sponsorship	Bundesministerium für Bildung und Forschung (BMBF); ROR-ID:04pz7b180
dc.identifier.uri	https://jlupub.ub.uni-giessen.de/handle/jlupub/20218
dc.identifier.uri	https://doi.org/10.22029/jlupub-19573
dc.language.iso	de
dc.relation	https://github.com/LukasKriesch/CommonCrawlNewsDataSet
dc.rights	CC0 1.0 Universal	en
dc.rights.uri	http://creativecommons.org/publicdomain/zero/1.0/
dc.subject	News
dc.subject	Natural Language Processing
dc.subject	Geographie
dc.subject	Nachrichtenartikel
dc.subject.ddc	ddc:004
dc.title	A geolocated dataset of German news articles
dc.type	Dataset
local.affiliation	FB 07 - Mathematik und Informatik, Physik, Geographie
local.project	031B1281