Czech Museum Websites

41 Last view: 2024-11-21

1 Last update: 2020-02-11

Czech Museum Websites

Parallel (cz-en) corpus of 25424 translation units.

DSI Relevance: Europeana

Distribution

Availability: Available

Licences

Under Review

Distribution Details

Contact Person

Fraser Bowen

text

Bilingual text corpusLanguages

English (en)

German (de)

Linguality

Linguality type: Bilingual

Multi-linguality type: Parallel

Text Format

TMX

Size

25,424 Translation Units

Character encoding

UTF-8

AnnotationAlignment

StandOff: False

Segmentation level: Sentence

Standard practices conformance: TMX

Annotation Mode: Automatic

Annotation Tools:

ILSP-FC alignment and TMX filtering module

Creation

Creation mode details: The ILSP Focused Crawler was used for the acquisition of bilingual data from multilingual websites, and for the normalization, cleaning, (near) de-duplication and identification of parallel documents. The Maligna sentence aligner was used for extracting segment alignments from crawled parallel documents. As a post-processing step, alignments were merged into one TMX file. The following filters were applied: TMX files generated from document pairs which have been identified by non-aupdih methods were discarded ; TMX files with a zeroToOne_alignments/total_alignments ratio larger than 0.16, were discarded ; Alignments of non-[1:1] type(s) were discarded. ; Alignments with a TUV (after normalization) that has less than 2 tokens, were discarded/annotated ; Alignments with a l1/l2 TUV length ratio smaller than 0.6 or larger than 1.6, were discarded/annotated ; Alignments in which different digits appear in each TUV were discarded/annotated ; Alignments with identical TUVs (after normalization) were removed. ; Alignments with only non-letters in at least one of their TUVs were removed ; Duplicate alignments were discarded. There are 99449 TUs with no annotation, containing 1721806 words and 103615 lexical types in de and 1906939 words and 54394 lexical types in en

Creation mode: Automatic

Creation Tools

http://nlp.ilsp.gr/r...

Resource Creation

Resource Creator

Deutsches Forschungszentrum für Kunstliche Intelligenz

Creation ended: 04/08/2016

Created using ELRC Services

Funding Project

European Language Resource Coordination LOT3 (ELRC Data - Tools and Resources for CEF Automated Translation-LOT3 (SMART 2015/1091-30-CE-0816766/00-92))

URL: http://www.lr-coordi...

Funding Type: Service Contract

Funder: European Commission

Funding Country: European Union (EU)

Project duration: 13/12/2016 - 12/02/2020

Metadata

Created: 15/08/2016

Metadata Language: English (en)

People who looked at this resource also viewed the following:

Resources from the same project

Resources from the same creators