This paper describes an approach for the classification of millions of existing multiword entities (MWEntities), such as organisation or event names, into thirteen category types, based only on the tokens they contain. In order to classify our very large in-house collection of multilingual MWEntities into an applicationoriented set of entity categories, we trained distantly-supervised classifiers in 43 languages based on MWEntities extracted from BabelNet. The best-performing classifier was the multi-class SVM using a TF.IDF-weighted data presentation. Interestingly, one unique classifier trained on a mix of all languages consistently performed better than classifiers trained for individual languages, reaching an averaged F1-value of 88.8%. In this paper, we present the training and test data, including a human evaluation of its accuracy, describe the methods used to train the classifiers,and discuss the results.
CHESNEY Sophie;
JACQUET Guillaume;
STEINBERGER Ralf;
PISKORSKI Jakub;
2018-01-12
The Association for Computational Linguistics (ACL)
JRC105656
978-1-945626-48-7,
http://aclweb.org/anthology/W17-17,
https://publications.jrc.ec.europa.eu/repository/handle/JRC105656,
| Name | Country | City | Type |
|---|
This document is only visible at the Commission level.
You are not authorized to publish or distribute it outside the European Commission.
This is a public document. You can share this publication.
Datasets
| ID | Title | Public URL |
|---|
Dataset collections
| ID | Acronym | Title | Public URL |
|---|
Scripts / source codes
| Description | Public URL |
|---|
Additional supporting files
| File name | Description | File type |
|---|