umjУниверситетское управление: практика и анализUniversity Management: Practice and Analysis1999-66401999-6659Federal State Autonomous Educational Institution of Higher Education «Ural Federal University named after the first President of Russia B.N.Yeltsin»; Non-Commercial Partnership “University Management: Practice andumj-385Research ArticleУПРАВЛЕНИЕ РЕПУТАЦИЕЙ ВУЗАMANAGING HIGHER EDUCATIONAL INSTITUTION'S REPUTATIONМетодология мировых рейтингов университетов: анализ и критикаMethodology of international university rankings: analysis and criticismКинчароваАнастасия ВладимировнаKincharovaA. V.nastya.kincharova@gmail.comЕвропейский универ­ситет в Санкт-ПетербургеRussian Federation201410042019027080Copyright © Кинчарова А.В., 20192019Кинчарова А.В.Kincharova A.V.Данная работа распространяется под лицензией Creative Commons Attribution 4.0.This work is licensed under a Creative Commons Attribution 4.0 License.https://www.umj.ru/jour/article/view/385

Статья содержит обзор работ, посвященных анализу и критике методологии крупнейших мировых рейтингов университетов, представленных в англоязычной научной литературе. Он предваряется кратким описанием устройства трех крупнейших рейтингов: ARWU, QS, THE. Основные направления критики: определение набора показателей рейтинговой системы; проблемы использования основных видов показателей: библио-метрических и peer review; проблемы взвешивания показателей и агрегирования их в индекс. В результате анализа ряд исследователей делает вывод об ограниченных возможностях использования результатов рейтинговых измерений.

The article contains a review of papers which analyse and criticise the methodology of the main world university rankings presented in the English-language literature. It is preceded by a brief description of structure of the three largest rankings: ARWU, QS, THE. The main directions of criticism are: specifics of the set of rating system indicators; problems of using the main types of indicators: the bibliometric ones and the peer review ones; problems of weighting indicators and their aggregation into one index. A number of researchers conclude that the opportunities of using the results of university rankings are quite limited.

рейтинги университетовметодология рейтинговпоказатели рейтинговой системыбиблиометрические показателипоказатели peer reviewагрегирование показателейuniversity rankingsranking methodologyindicators of ranking systembibliometric indicatorspeer review indicatorsaggregation of indicatorsReferencesAltbach P. G. The globalization of college and university rankings // Change: The Magazine of Higher Learning. 2012. Vol. 44, № 1. P. 26-31.Altbach P. G. The globalization of college and university rankings // Change: The Magazine of Higher Learning. 2012. Vol. 44, № 1. P. 26-31.BillautJ.-C., Bouyssou D, Vincke P. Should you believe in the Shanghai ranking? // Scientometrics. 2010. Vol. 84, № 1. P. 237-263.BillautJ.-C., Bouyssou D, Vincke P. Should you believe in the Shanghai ranking? // Scientometrics. 2010. Vol. 84, № 1. P. 237-263.Burris V. The academic caste system: Prestige hierarchies in PhD exchange networks // American Sociological Review. 2004. Vol. 69, № 2. P. 239-264.Burris V. The academic caste system: Prestige hierarchies in PhD exchange networks // American Sociological Review. 2004. Vol. 69, № 2. P. 239-264.Daraio C. et al. The European university landscape: A micro characterization based on evidence from the Aquameth project // Research Policy. 2011. Vol. 40, № 1. P. 148-164.Daraio C. et al. The European university landscape: A micro characterization based on evidence from the Aquameth project // Research Policy. 2011. Vol. 40, № 1. P. 148-164.Dill D. D., Soo M. Academic quality, league tables, and public policy: A cross-national analysis of university ranking systems // Higher Education. 2005. Vol. 49, № 4. P. 495-533.Dill D. D., Soo M. Academic quality, league tables, and public policy: A cross-national analysis of university ranking systems // Higher Education. 2005. Vol. 49, № 4. P. 495-533.Florian R. V. Irreproducibility of the results of the Shanghai academic ranking of world universities // Scientometrics. 2007. Vol. 72, № 1. P. 25-32.Florian R. V. Irreproducibility of the results of the Shanghai academic ranking of world universities // Scientometrics. 2007. Vol. 72, № 1. P. 25-32.Holmes R. The THES university rankings: Are they really world class // Asian Journal of university education. Vol. 1, № 1. 2006. P. 1-14.Holmes R. The THES university rankings: Are they really world class // Asian Journal of university education. Vol. 1, № 1. 2006. P. 1-14.Huang M.-H. Opening the black box of QS World University Rankings // Research Evaluation. 2012. Vol. 21, № 1. P. 71-78.Huang M.-H. Opening the black box of QS World University Rankings // Research Evaluation. 2012. Vol. 21, № 1. P. 71-78.Ioannidis J. P. A. et al. International ranking systems for universities and institutions: a critical appraisal [Electronic resource] // BMC Medicine. 2007. 5:30. URL: http://www.biomedcentral.com/1741-7015/5/30 (accessed: 18.03.2013).Ioannidis J. P. A. et al. International ranking systems for universities and institutions: a critical appraisal [Electronic resource] // BMC Medicine. 2007. 5:30. URL: http://www.biomedcentral.com/1741-7015/5/30 (accessed: 18.03.2013).Jeremic V., Markovic A., Bulajic M. A critical assessment of international university ranking system // Proceedings of the XIII International Symposium SymOrg 2012: Innovative Management and Business Performance / ed. M. L. Jaksic, S. Barjaktarovic Rakocevic University of Belgrad. Faculty of the Organizational Science, 2012. P. 554-559.Jeremic V., Markovic A., Bulajic M. A critical assessment of international university ranking system // Proceedings of the XIII International Symposium SymOrg 2012: Innovative Management and Business Performance / ed. M. L. Jaksic, S. Barjaktarovic Rakocevic University of Belgrad. Faculty of the Organizational Science, 2012. P. 554-559.Liu N. C., Cheng Y. The academic ranking of world universities // Higher education in Europe. 2005. Vol. 30, № 2. P. 127-136.Liu N. C., Cheng Y. The academic ranking of world universities // Higher education in Europe. 2005. Vol. 30, № 2. P. 127-136.Moed H. F. Bibliometric rankings of world universities [Electronic resource]. CWTS Report 2006-01. 2006. URL: http://www.cwts.nl/hm/bibl_rnk_wrld_univ_ full.pdf (accessed: 18.03.2013).Moed H. F. Bibliometric rankings of world universities [Electronic resource]. CWTS Report 2006-01. 2006. URL: http://www.cwts.nl/hm/bibl_rnk_wrld_univ_ full.pdf (accessed: 18.03.2013).Paruolo P., Saltelli A., Saisana M. Ratings and rankings: Voodoo or Science? [Electronic resource]. arXiv preprint, arXiv:1104.3009v2 [stat.AP]. 2011. URL: http:// arxiv.org/abs/1104.3009v2 (accessed: 18.03.2013).Paruolo P., Saltelli A., Saisana M. Ratings and rankings: Voodoo or Science? [Electronic resource]. arXiv preprint, arXiv:1104.3009v2 [stat.AP]. 2011. URL: http:// arxiv.org/abs/1104.3009v2 (accessed: 18.03.2013).Rindova V. P. et al. Being good or being known: An empirical examination of the dimensions, antecedents, and consequences of organizational reputation // Academy of Management Journal. 2005. Vol. 48, № 6. P. 1033-1049.Rindova V. P. et al. Being good or being known: An empirical examination of the dimensions, antecedents, and consequences of organizational reputation // Academy of Management Journal. 2005. Vol. 48, № 6. P. 1033-1049.Tofallis C. A different approach to university rankings // Higher Education. 2012. Vol. 63, № 1. P. 1-18.Tofallis C. A different approach to university rankings // Higher Education. 2012. Vol. 63, № 1. P. 1-18.Van Raan A. F. J. Challenges in ranking of universities [Electronic resource] // Invited paper for the First International Conference on World Class Universities. Jaio Tong University. Shanghai. June 16-18, 2005. URL: http://citeseerx.ist.psu.edu/viewdoc/ download?doi=10.1.1.104.4501&rep=rep1&type=pdf&a=bi &pagenumber=1&w=100 (accessed:18 марта 2013).Van Raan A. F. J. Challenges in ranking of universities [Electronic resource] // Invited paper for the First International Conference on World Class Universities. Jaio Tong University. Shanghai. June 16-18, 2005. URL: http://citeseerx.ist.psu.edu/viewdoc/ download?doi=10.1.1.104.4501&rep=rep1&type=pdf&a=bi &pagenumber=1&w=100 (accessed:18 марта 2013).Van Raan A. F. J. Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods // Scientometrics. 2005. Vol. 62, № 1. P. 133-143.Van Raan A. F. J. Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods // Scientometrics. 2005. Vol. 62, № 1. P. 133-143.Waltman L. et al. The Leiden Ranking 2011/2012: Data collection, indicators, and interpretation [Electronic resource]. arXiv preprint, arXiv:1202.3941v1 [cs.DL]. 2012. URL: http://arxiv.org/abs/1202.3941 (accessed: 18.03.2013).Waltman L. et al. The Leiden Ranking 2011/2012: Data collection, indicators, and interpretation [Electronic resource]. arXiv preprint, arXiv:1202.3941v1 [cs.DL]. 2012. URL: http://arxiv.org/abs/1202.3941 (accessed: 18.03.2013).Yonezawa A. Much ado about ranking: why can't Japanese universities internationalize? // Japan Forum. 2010. Vol. 22, № 1-2. P. 121-137.Yonezawa A. Much ado about ranking: why can't Japanese universities internationalize? // Japan Forum. 2010. Vol. 22, № 1-2. P. 121-137.Zitt M., Filliatreau G. Big is (made) beautiful: Some comments about the Shanghai ranking of world-class universities // The World-Class University and Ranking: Aiming Beyond Status / ed. J. Sadlak, Nian Cai Liu. UNESCO-CEPES and Shanghai Jiao Tong University : Cluj University Press, 2007. P. 17-24.Zitt M., Filliatreau G. Big is (made) beautiful: Some comments about the Shanghai ranking of world-class universities // The World-Class University and Ranking: Aiming Beyond Status / ed. J. Sadlak, Nian Cai Liu. UNESCO-CEPES and Shanghai Jiao Tong University : Cluj University Press, 2007. P. 17-24.

The authors declare that there are no conflicts of interest present.