Multilingual (EN, MK, SQ) corpus from websites of government of North Macedonia v.1.0

Multilingual dataset (EN, MK, SQ) based on the content of websites of the government of North Macedonia. It includes 177103 Translation Units in total. It was generated by crawling the websites in February 2021, detecting pairs of parallel documents, identifying parallel sentence pairs and filtering the results. The number of TUs are:
75701 en-mk
23412 en-sq
77990 mk-sq