Given a full news article and a question, the system must find the shortest span of text in the article (if it exists) that answers the question.
Publication
Aiala Rosá, Luis Chiruzzo, Lucía Bouza, Alina Dragonetti, Santiago Castro, Mathias Etcheverry, Santiago Góngora, Santiago Goycoechea, Juan Machado, Guillermo Moncecchi, Juan José Prada, Dina Wonsever (2022) Overview of QuALES at IberLEF 2022: Question Answering Learning from Examples in Spanish. Procesamiento del Lenguaje Natural, Revista nº 69, septiembre de 2022, pp. 273-280.
Language
Spanish
NLP topic
Abstract task
Year
2022
Publication link
Ranking metric
Exact Match
Task results
| System | Precision | Recall | F1 | CEM | Accuracy | MacroPrecision | MacroRecall | MacroF1 | RMSE | MicroPrecision | MicroRecall | MicroF1 | MAE | MAP | UAS | LAS | MLAS | BLEX | Pearson correlation | Spearman correlation | MeasureC | BERTScore | EMR | Exact Match Sort ascending | F0.5 | Hierarchical F | ICM | MeasureC | Propensity F | Reliability | Sensitivity | Sentiment Graph F1 | WAC | b2 | erde30 | sent | weighted f1 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sebastianvolti | 0.53 | ||||||||||||||||||||||||||||||||||||
| ichramm | 0.47 | ||||||||||||||||||||||||||||||||||||
| smaximo | 0.46 | ||||||||||||||||||||||||||||||||||||
| Bernardo | 0.44 | ||||||||||||||||||||||||||||||||||||
| avacaondata | 0.40 |
