Аннотация:This paper introduces a new approach to esti- mating the text document complexity. Com- mon readability indices are based on average length of sentences and words. In contrast to these methods, we propose to count the num- ber of rare words occurring abnormally often in the document. We use the reference corpus of texts and the quantile approach in order to determine what words are rare, and what fre- quencies are abnormal. We construct a general text complexity model, which can be adjusted for the specific task, and introduce two special models. The experimental design is based on a set of thematically similar pairs of Wikipedia articles, labeled using crowdsourcing. The ex- periments demonstrate the competitiveness of the proposed approach.