ИСТИНА

The report is devoted to the forum RU-EVAL-3. The first two events were devoted to morphological and syntactic parsing correspondingly. The third event was devoted to anaphora and coreference resolution. Seven participating IT companies and academic institutions submitted their results for the anaphora resolution task and three of them presented the results of the coreference resolution task as well. The event was organized in order to estimate the state of the art for this NLP task in Russian and to compare various methods and principles implemented for Russian. The evaluation procedure was prepared by the group of students from the Deapartment of Theoretical and Applied Linguisitcs. In our report we discuss the details of the evaluation procedure. We formulate the training and Gold Standard corpora onstruction guidelines and present the measures used in evaluation.