Anonymised ParaCrawl release 8 German-English

40 Last view: 2024-11-21

2 Last update: 2021-04-21

Anonymised ParaCrawl release 8 German-English

Anonymised ParaCrawl 8 de-en

https://paracrawl.eu/

This corpus was run through BiRoamer https://github.com/bitextor/biroamer to anonymise the German-English parallel data from release 8 of the ParaCrawl project, specifically "Broader Web-Scale Provision of Parallel Corpora for European Languages". This version is filtered with BiCleaner with a threshold of 0.5. Data was crawled from the web following robots.txt, as is standard practice. The crawl is not targeted to a particular domain, intending to provide broad coverage. Anonymisation is an automated process driven by named entity recognition and is far from perfect.

DSI Relevance: BusinessRegistersInterconnectionSystem, Cybersecurity, ElectronicExchangeOfSocialSecurityInformation, Europeana, OnlineDisputeResolution, OpenDataPortal, eHealth, eJustice, eProcurement, saferInternet

Distribution

Availability: Under Review

Licences

CC0-1.0

Distribution Details

Download location : https://s3.amazonaws...

Distribution Medium: Data Downloadable

Personal Data: YES

Contact Person

Kenneth Heafield

text

Bilingual text corpusLanguages

German (de)

English (en)

Linguality

Linguality type: Bilingual

Multi-linguality type: Parallel

Text Format

TMX

Size

213,698,600 Translation Units

Character encoding

UTF-8

Resource Creation

Funding Project

Broader Web-Scale Provision of Parallel Corpora for European Languages (Paracrawl)

URL: http://paracrawl.eu/

Funding Type: Eu Funds

Funder: European Commission

Metadata

Created: 19/04/2021

Last Updated: 19/04/2021

Metadata Language: English (en)

People who looked at this resource also viewed the following:

Resources from the same project