Parallel corpus (Polish - English) from the website of the Polish Investment and Trade Agency (Processed)

17 Last view: 2020-01-23

5 Last download: 2020-01-23

Parallel corpus (Polish - English) from the website of the Polish Investment and Trade Agency (Processed)

Attribution details: Parallel corpus (Polish - English) was created for the European Language Resources Coordination Action (ELRC) (http://lr-coordination.eu/) by ELRC Consortium partner, ILSP/R.C. "Athena" (https://www.athena-innovation.gr/) from the website of the Polish Investment and Trade Agency (https://www.paih.gov.pl)

Parallel (pl-en) corpus of 14736 translation units in the "BUSINESS AND COMPETITION" and "ECONOMICS" domains.

Distribution

Availability: Available

Licences

Open Under-PSI

Used for resources that fall under the scope of PSI (Public Sector Information) regulations, and for which no further information is required or available. For more information on the EU legislation on the reuse of Public Sector Information, see here: https://ec.europa.eu/digital-single-market/en/european-legislation-reuse-public-sector-information.

Distribution Details

Attribution Details: Parallel corpus (Polish-English) was created for the European Language Resources Coordination Action (ELRC) (http://lr-coordination.eu/) by ELRC Consortium partner, ILSP/R.C. "Athena" (https://www.athena-innovation.gr/) from the website of the Polish Investment and Trade Agency (https://www.paih.gov.pl)

IPR Holders

The Polish Investment and Trade Agency

Contact Person

Vassilis Papavassiliou

text

Bilingual text corpusLanguages

English (en) (270,941 Words)

Polish (pl) (222,325 Words)

Linguality

Linguality type: Bilingual

Multi-linguality type: Parallel

Text Format

TMX

Size

14,736 Translation Units

Character encoding

UTF-8

Domains

ECONOMICS (Eurovoc 16)

BUSINESS & COMPETITION

AnnotationAlignment

StandOff: False

Segmentation level: Sentence

Standard practices conformance: TMX

Annotation Mode: Automatic

Annotation Tools:

ILSP-FC alignment and TMX filtering module

Creation

Creation mode details: The ILSP Focused Crawler was used for the acquisition of bilingual data from multilingual websites, and for the normalization, cleaning, (near) de-duplication and identification of parallel documents. The Maligna sentence aligner was used for extracting segment alignments from crawled parallel documents. As a post-processing step, alignments were merged into one TMX file. The following filters were applied: TMX files generated from document pairs which have been identified by non-aupdih methods were discarded ; TMX files with a zeroToOne_alignments/total_alignments ratio larger than 0.16, were discarded ; Alignments of non-[1:1] type(s) were discarded. ; Alignments with a TUV (after normalization) that has less than 3 tokens, were discarded/annotated ; Alignments with a l1/l2 TUV length ratio smaller than 0.6 or larger than 1.6, were discarded/annotated ; Alignments in which different digits appear in each TUV were kept and annotated. ; Alignments with identical TUVs (after normalization) were removed. ; Alignments with only non-letters in at least one of their TUVs were removed ; Exact Duplicate alignments were discarded. The mean value of aligner's scores is 6.009806921990764, the std value is 0.9243181998035448. The mean value of length (in terms of characters) ratios is 1.0146147524328113 and the std value is 0.19039534371430675. There are 14736 TUs with no annotation, containing 270941 words and 15428 lexical types in en and 222325 words and 31073 lexical types in pl.

Creation mode: Automatic

Creation Tools

http://nlp.ilsp.gr/r...

Resource Creation

Creation lasted: 28/03/2018 - 28/03/2018

Funding Project

European Language Resource Coordination LOT3 (ELRC Data - Tools and Resources for CEF Automated Translation-LOT3 (SMART 2015/1091-30-CE-0816766/00-92))

URL: http://www.lr-coordi...

Funding Type: Service Contract

Funder: European Commission

Funding Country: European Union (EU)

Project duration: 13/12/2016 - 12/02/2020

Metadata

Created: 11/04/2017

Last Updated: 12/04/2017

Metadata Language: English (en)

Metadata Creator

Vassilis Papavassiliou

Version

Version: 2.0

Last Updated: 28/03/2018

Relations

Related Resource: Parallel corpus (Polish - English) from the website of the Polish Investment and Trade Agency

Relation Type: Is Version Of

People who looked at this resource also viewed the following:

People who downloaded this resource also downloaded the following:

Resources from the same project