SemEval-2017 Task 1: Semantic Textual Similarity Multilingual and Crosslingual Focused Evaluation

Semantic Textual Similarity measures the meaning similarity of sentences. The task is motivated by the observation that accurately modeling the meaning similarity of sentences is a foundational language understanding problem relevant to numerous applications. To encourage and support research in this area, the STS shared task has been held annually since 2012, providing a venue for evaluation of state-of-the-art algorithms and models. The 2017 task focuses on multilingual and cross-lingual pairs with one sub-track exploring MT quality estimation data.