Student Engagement as an Instrument of Assessing the Quality of Education in Russian Universities
https://doi.org/10.15826/umpa.2023.02.012
Abstract
The article aims at presenting the experience of using the student engagement approach, which was developed on the basis of ideas of A. Astin, R. Pace, G. Kuh, P. Ewell, E. Pascarella, P. Terenzini, to assess the quality of education in Russian universities. This approach was originally implemented in the US higher education system at the end of the XX century. Due to its simplicity and relatively low costs demanded, as well as the possibility to develop effective specific recommendations for improving the educational process, this approach came to be further applied in other countries by single universities and even at national level. However, its applicability in the systems different from the US higher education is still questionable. The article presents the basic assumptions of this approach, the history of its development and spread across the world, and its potential for assessing the quality of higher education. The author pays particular attention to the implementation of the approach in Russian universities and its limitations due to peculiarities of national context. This paper is the first to summarize the results of Russian research on student engagement. It becomes possible to make certain conclusions about the applicability of this approach to the Russian system of higher education. Moreover, the author draws conclusions on the potential to compare student engagement data collected during different time intervals in different institutions and countries. Finally, the article gives practical recommendations on how to use this approach when solving different university problems. The paper is intended for university administrators to develop effective educational policy, for professors to improve teaching practices and student-faculty interaction, for researchers to understand the landscape of studies on student engagement and to distinguish promising directions for future investigations.
Keywords
student engagement,
higher education quality assessment,
educational environment,
educational context,
teaching practices,
Russian universities
Supporting agencies: Support from the Basic Research Program of the National Research University Higher School of Economics is gratefully acknowledged.
About the Author
N. G. Maloshonok
National Research University Higher School of Economics
Russian Federation
Russian Federation
Natalia G. Maloshonok – PhD (Sociology), Senior Researcher of the Centre for Sociology of Higher Education
16/10 Potapovsky lane, Moscow, 101000
References
1. McCormick A. C. Toward Reflective Accountability: Using NSSE for Accountability and Transparency. New Directions for Institutional Research, 2009, vol. 141, pp. 97–106. doi 10.1002/ir.289. (In Eng.).
2. McCormick A. C., Kinzie J., Gonyea R. M. Student Engagement: Bridging Research and Practice to Improve the Quality of Undergraduate Education. In: M. B. Paulsen (Ed.), Higher Education: Handbook of Theory and Research. Vol. 28, Springer, 2013, pp. 47–92. (In Eng.).
3. Krause K. L., Coates H. Students’ Engagement in First-Year University. Assessment & Evaluation in Higher Education, 2008, vol. 33, no. 5, pp. 493–505. doi 10.1080/02602930701698892. (In Eng.).
4. Kuh G. D. What We’re Learning About Student Engagement From NSSE: Benchmarks for Effective Educational Practices. Change: The Magazine of Higher Learning, 2003, vol. 35, no. 2, pp. 24–32. doi 10.1080/00091380309604090. (In Eng.).
5. Kuh G. D. What Student Engagement Data Tell Us about College Readiness. Peer Review, 2007, vol. 9, no. 1, pp. 4–8. (In Eng.).
6. Coates H., McCormick A. C. Introduction: Student Engagement – A Window into Undergraduate Education. In: Coates H., McCormick A. C. (Eds.) Engaging University Students: International Insights from System-Wide Studies, Springer, 2014, pp. 1–12. (In Eng.).
7. Zeng L. M., Fryer L. K., Zhao Y. A Comparison of Three Major Instruments Used for the Assessment of University Student Experience: Toward a Comprehensive and Distributed Approach. Higher Education Quarterly, 2023, vol. 77, no. 1, pp. 27–44. doi 10.1111/hequ.12363. (In Eng.).
8. Coates H. B. Australasian Survey of Student Engagement: Institution Report. [S. l.] : ACER, 2008. 27 p. (In Eng.).
9. Coates H. Development of the Australasian survey of student engagement (AUSSE). Higher Education, 2010, vol. 60, no. 1, pp. 1–17. doi 10.1007/s10734-009-9281-2. (In Eng.).
10. Gilardi S., Guglielmetti C. University Life of Non-Traditional Students: Engagement Styles and Impact on Attrition. The Journal of Higher Education, 2011, vol. 82, no. 1, pp. 33–53. doi 10.1080/00221546.2011.11779084. (In Eng.).
11. Chi X., Liu J., Bai Y. College Environment, Student Involvement, and Intellectual Development: Evidence in China. Higher Education, 2017, vol. 74, no. 1, pp. 81–99. doi 10.1007/s10734-016-0030-z. (In Eng.).
12. Yamada R. Comparison of Student Experiences in the Era of Massification: Analysis of Student Data from Japan, Korea and the USA. In K. Mok (Ed.), Managing International Connectivity, Diversity of Learning and Changing Labour Markets, Springer, 2017, pp. 169–186. (In Eng.).
13. Choi B. K., Rhee B. S. The Influences of Student Engagement, Institutional Mission, and Cooperative Learning Climate on the Generic Competency Development of Korean Undergraduate Students. Higher Education, 2014, vol. 67, no. 1, pp. 1–18. doi 10.1007/s10734-013-9637-5. (In Eng.).
14. Strydom F., Kuh G., Mentz M. Enhancing Success in South Africa’s Higher Education: Measuring Student Engagement. Acta Academica, 2010, vol. 42, no. 1, pp. 259–278. (In Eng.).
15. Tadesse T., Manathunga C. E., Gillies R. M. The Development and Validation of the Student Engagement Scale in an Ethiopian University Context. Higher Education Research & Development, 2018, vol. 37, no. 1, pp. 188–205. doi 10.1080/07294360.2017.1342605. (In Eng.).
16. Pravdina M. Stili prepodavaniya i vovlechennost’ studentov GU VShE v protsess obucheniya: otsenka pozitivnykh effektov [Teaching Styles and Engagement of HSE Students in the Learning Process: Evaluation of Positive Effects]. Monitoring universiteta, 2010, no. 3, pp. 2–11. (In Russ.).
17. Zhao C.-M., Kuh G. D., Carini R. M. A Comparison of International Student and American Student Engagement in Effective Educational Practices. The Journal of Higher Education, 2005, vol. 76, no. 2, pp. 209–231. doi 10.1080/00221546.2005.11778911. (In Eng.).
18. Huang Y.-R., Chang S.-M. Academic and Cocurricular Involvement: Their Relationship and the Best Combinations for Student Growth. Journal of College Student Development, 2004, vol. 45, no. 4, pp. 391–406. doi 10.1353/csd.2004.0049. (In Eng.).
19. Hsieh T.-L. Motivation Matters? The Relationship among Different Types of Learning Motivation, Engagement Behaviors and Learning Outcomes of Undergraduate Students in Taiwan. Higher Education, 2014, vol. 68, no. 3, pp. 417–433. doi 10.1007/s10734-014-9720-6. (In Eng.).
20. Hagel P., Carr R., Devlin M. Conceptualising and Measuring Student Engagement through the Australasian Survey of Student Engagement (AUSSE): A Critique. Assessment & Evaluation in Higher Education, 2012, vol. 37, no. 4, pp. 475–486. doi 10.1080/02602938.2010.545870. (In Eng.).
21. Maloshonok N., Shcheglova I. Do the Effects of Student Engagement on the Development of Generic Differ across Nations? European Journal of Higher Education, 2023, vol. 13, no. 1, pp. 80–101. doi 10.1080/21568235.2021.1992641. (In Eng.).
22. Maloshonok N. Do Student Engagement Patterns Differ Across National Higher Education Systems? The Comparison of US, Chinese, and Russian High-Level Research-Intensive Universities. Innovations in Education and Teaching International, 2023, February, 26, pp. 1–12. doi 10.1080/14703297.2023.2183883. (In Eng.).
23. Carini R. M., Kuh G. D., Klein S. P. Student Engagement and Student Learning: Testing the Linkages. Research in Higher Education, 2006, vol. 47, pp. 1–32. doi 10.1007/s11162-005-8150-9. (In Eng.).
24. Kuh G. D., Cruce T. M., Shoup R., Kinzie J., Gonyea R. M. Unmasking the Effects of Student Engagement on First-Year College Grades and Persistence. The Journal of Higher Education, 2008, vol. 79, no. 5, pp. 540–563. doi 10.1080/00221546.2008.11772116. (In Eng.).
25. Kuh G. D. The National Survey of Student Engagement: Conceptual and Empirical Foundations. New Directions for Institutional Research, 2009, vol. 141, pp. 5–20. doi 10.1002/ir.283. (In Eng.).
26. Pascarella E. T., Seifert T. A., Blaich C. How Effective are the NSSE Benchmarks in Predicting Important Educational Outcomes? Change: The Magazine of Higher Learning, 2010, vol. 42, no. 1, pp. 16–22. doi 10.1080/00091380903449060. (In Eng.).
27. Kahu E. R. Framing Student Engagement in Higher Education. Studies in Higher Education, 2013, vol. 38, no. 5, pp. 758–773. doi 10.1080/03075079.2011.598505. (In Eng.).
28. Maloshonok N. G. Studencheskaya vovlechennost’ kak sotsial’noe yavlenie: teoriya i metodologiya issledovaniya [Student Engagement as a Social Phenomenon: Theory and Methodology of Research], PhD thesis, Moscow, 2014, 232 p. (In Russ.).
29. Mann S. J. Alternative Perspectives on the Student Experience: Alienation and Engagement. Studies in Higher Education, 2001, vol. 26, no. 1, pp. 7–20. doi 10.1080/03075070020030689. (In Eng.).
30. Thomas L. Student Retention in Higher Education: The Role of Institutional Habitus. Journal of Education Policy, 2002, vol. 17, no. 4, pp. 423–442. doi 10.1080/02680930210140257. (In Eng.).
31. Bryson C., Hardy C., Hand L. An In-Depth Investigation of Students’ Engagement throughout Their First Year in University. UK National Transition Conference, Newcastle University, 2009, s. p. (In Eng.).
32. Pascarella E. T. Using Student Self-Reported Gains to Estimate College Impact: A Cautionary Tale. Journal of College Student Development, 2001, vol. 42, no. 5, pp. 488–492. (In Eng.).
33. Ewell P. T., Jones D. P. Actions Matter: The Case for Indirect Measures in Assessing Higher Education’s Progress on the National Education Goals. Journal of General Education, 1993, vol. 42, no. 2, pp. 56–121. (In Eng.).
34. Ewell P. T., Jones D. P. Indicators of «Good Practice» in Undergraduate Education: A Handbook for Development and Implementation. Boulder, CO: National Center for Higher Education Management Systems, 1996. 117 p. (In Eng.).
35. Long D. Theories and Models of Student Development. In: L. J. Hinchliffe & M. A. Wong (Eds.), Environments for Student Growth and Development: Librarians and Student Affairs in Collaboration, Chicago, 2012, pp. 41–55. (In Eng.).
36. Astin A. W. Student Involvement: A Developmental Theory for Higher Education. Journal of College Student Personnel, 1984, vol. 25, no. 4, pp. 297–308. (In Eng.).
37. Astin A. W. Student Involvement: A Developmental Theory for Higher Education. Journal of College Student Development, 1999, vol. 40, no. 5, pp. 518–529. (In Eng.).
38. Pace R. C. Measuring the Quality of Student Effort. Current Issues in Higher Education, 1980, vol. 2, no. 1, pp. 10–16. (In Eng.).
39. Pace C. R. Measuring the Quality of College Student Experiences: An Account of the Development and Use of the College Student Experiences. Questionnaire. University of California: Higher Education Research Institute, Graduate School of Education, 1984. 142 p. (In Eng.).
40. Kuh G. D., Kinzie J. L., Buckley J. A., Bridges B. K., Hayek, J. C. What Matters to Student Success: A Review of the Literature (Vol. 8). Washington, DC: National Postsecondary Education Cooperative, 2006. 156 p. (In Eng.).
41. Chickering A. W., Gamson Z. F. Seven Principles for Good Practice in Undergraduate Education. AAHE Bulletin, 1987, vol. 39, no. 7, pp. 3–7. (In Eng.).
42. Kuh G. D., Pace C. R., Vesper N. The Development of Process Indicators to Estimate Student Gains Associated with Good Practices in Undergraduate Education. Research in Higher Education, 1997, vol. 38, no. 4, pp. 435–454. (In Eng.).
43. McCormick A. C., Gonyea R. M., Kinzie J. Refreshing Engagement: NSSE at 13. Change: The Magazine of Higher Learning, 2013, vol. 45, no. 3, pp. 6–15. doi 10.1080/00091383.2013.786985. (In Eng.).
44. Howson C., Buckley A. Development of the UK Engagement Survey. Assessment & Evaluation in Higher Education, 2017, vol. 42, no. 7, pp. 1132–1144. doi 10.1080/02602938.2016.1235134. (In Eng.).
45. Ross H., Cen Y., Zhou Z. Assessing Student Engagement in China: Responding to Local and Global Discourse on Raising Educational Quality. Current Issues in Comparative Education, 2011, vol. 14, no. 1, pp. 24–37. (In Eng.).
46. Shi J., Wang S., Li G. «Why» and «How» Matters: Student Engagement in China’s Universities. Higher Education Forum, 2013, vol. 10, pp. 51–70. (In Eng.).
47. Maloshonok N. G. Vzaimosvyaz’ ispol’zovaniya Interneta i mul’timediinykh tekhnologii v obrazovatel’nom protsesse so studencheskoi vovlechennost’yu [How Using the Internet and Multimedia Technology in the Learning Process Correlates with Student Engagement]. Voprosy obrazovaniya, 2016, no. 4, pp. 59–83. doi 10.17323/1814-9545-2016-4-59-83. (In Russ.).
48. Shcheglova I. A. Kross-kul’turnoe sravnenie uchebnoi vovlechennosti studentov [Cross-Cultural Comparison of Students’ Academic Engagement]. Universitetskoe upravlenie: praktika i analiz, 2018, vol. 22, no. 3 (115), pp. 155–164. doi 10.15826/umpa.2018.03.034. (In Russ.).
49. Shcheglova I. A., Koreshnikova Yu. N., Parshina O. A. Rol’ studencheskoi vovlechennosti v razvitii kriticheskogo myshleniya [The Role of Engagement in the Development of Critical Thinking in Undergraduates]. Voprosy obrazovaniya, 2019, no. 1, pp. 264–289. doi 10.17323/1814-9545-2019-1-264-289. (In Russ.).
50. Shcheglova I., Gorbunova E., Chirikov I. The Role of the First-Year Experience in Student Attrition. Quality in Higher Education, 2020, vol. 26, no. 3, pp. 307–322. doi 10.1080/13538322.2020.1815285. (In Eng.).
51. Kahn P. Higher Education Policy on Student Engagement: Thinking Outside the Box. Higher Education Policy, 2017, vol. 30, no. 1, pp. 53–68. doi 10.1057/s41307-016-0031-7. (In Eng.).
52. Kahn P. Theorizing Student Engagement in Higher Education. British Educational Research Journal, 2014, vol. 40, no. 6, pp. 1005–1018. doi 10.1002/berj.3121. (In Eng.).
53. Macfarlane B., Tomlinson M. Critiques of Student Engagement. Higher Education Policy, 2017, vol. 30, no. 1, pp. 5–21. doi 10.1057/s41307-016-0027-3. (In Eng.).
54. Bowman N. A. Can 1st-Year College Students Accurately Report Their Learning and Development? American Educational Research Journal, 2010, vol. 47, no. 2, pp. 466– 496. doi 10.3102/0002831209353595. (In Eng.).
55. Conway J. M., Lance C. E. What Reviewers Should Expect from Authors Regarding Common Method Bias in Organizational Research. Journal of Business and Psychology, 2010, vol. 25, pp. 325–334. doi 10.1007/s10869-010-9181-6. (In Eng.).
56. Zilvinskis J., Masseria A. A., Pike G. R. Student Engagement and Student Learning: Examining the Convergent and Discriminant Validity of the Revised National Survey of Student Engagement. Research in Higher Education, 2017, vol. 58, no. 8, pp. 880–903. doi 10.1007/s11162-017-9450-6. (In Eng.).
57. Zepke N. Student Engagement Research in Higher Education: Questioning an Academic Orthodoxy. Teaching in Higher Education, 2014, vol. 19, no. 6, pp. 697–708. doi 10.1080/13562517.2014.901956. (In Eng.).
58. Macfarlane B. Student Performativity in Higher Education: Converting Learning as a Private Space into a Public Performance. Higher Education Research & Development, 2015, vol. 34, no. 2, pp. 338–350. doi 10.1080/07294360.2014.956697. (In Eng.).
59. Kinzie J., Gonyea R., Kuh G. D., Umbach P., Blaich C., Korkmaz A. The Relationship between Gender and Student Engagement in College. 32nd Annual Conference of the Association for the Study of Higher Education, Louisville, 2007, pp. 1–36. (In Eng.).
60. Saenz V. B., Hatch D., Bukoski B. E., Kim S., Lee K. H., Valdez P. Community College Student Engagement Patterns: A Typology Revealed through Exploratory Cluster Analysis. Community College Review, 2011, vol. 39, no. 3, pp. 235–267. doi 10.1177/0091552111416643. (In Eng.).
61. Sontam V., Gabriel G. Student Engagement at a Large Suburban Community College: Gender and Race Differences. Community College Journal of Research and Practice, 2012, vol. 36, no. 10, pp. 808–820. doi 10.1080/10668926.2010.491998. (In Eng.).
62. Hu S., Wolniak G. C. College Student Engagement and Early Career Earnings: Differences by Gender, Race/ Ethnicity, and Academic Preparation. The Review of Higher Education, 2013, vol. 36, no. 2, pp. 211–233. doi 10.1353/rhe.2013.0002. (In Eng.).
63. Hu S., Kuh G. D. Being (Dis)Engaged in Educationally Purposeful Activities: The Influences of Student and Institutional Characteristics. Research in Higher Education, 2002, vol. 43, no. 5, pp. 555–575. doi 10.1023/A:1020114231387. (In Eng.).
64. Hedrick B., Dizen M., Collins K., Evans, J. Grayson T. Perceptions of College Students with and without Disabilities and Effects of STEM and Non-STEM Enrollment on Student Engagement and Institutional Involvement. Journal of Postsecondary Education and Disability, 2010, vol. 23, no. 2, pp. 129–136. (In Eng.).
65. Maloshonok N. G. Studencheskaya vovlechennost’: pochemu vazhno izuchat’ protsess obucheniya, a ne tol’ko ego rezul’tat? [Student Engagement: Why Is It Important to Investigate the Educational Process, not only Its Result?]. Monitoring universiteta, 2011, no. 6, pp. 11–21. (In Russ.).
66. Froumin I. D., Dobryakova M. S. Chto zastavlyaet menyat’sya rossiiskie vuzy: dogovor o nevovlechennosti [What Makes Russian Universities Change: Disengagement Compact]. Voprosy obrazovaniya, 2012, no. 2, pp. 159–191. (In Russ.).
67. Maloshonok N. G. Izmerenie studencheskoi vovlechennosti: osnovnye metody i ikh ogranicheniya [On the Student Engagement Measurement: Basic Methods and Their Restrictions]. Sotsiologiya: metodologiya, metody, matematicheskoe modelirovanie, 2013, no. 36, pp. 177–199. (In Russ.).
68. Maloshonok N. G. Vovlechennost’ studentov v uchebnyi protsess v NIU VShE v 2011 i 2012 gg. [Student Engagement in the Educational Process at the Higher School of Economics in 2011 and 2012]. Universitas. Zhurnal o zhizni universitetov, 2013, vol. 1, no. 1, pp. 23–47. (In Russ.).
69. Maloshonok N. G. Vovlechennost’ studentov v uchebnyi protsess v rossiiskikh vuzakh [Student Engagement in Learning in Russian Universities]. Vysshee obrazovanie v Rossii, 2014, no. 1, pp. 37–44. (In Russ.).
70. Maloshonok N. G. Studencheskaya vovlechennost’ v uchebnyi protsess: metodologiya issledovanii i protsedura izmereniya [Student Involvement in the Educational Process: Research Methodology and Measurement Procedure]. Sotsiologicheskie issledovaniya, 2014, no. 3 (359), pp. 141–147. (In Russ.).
71. Otchet po proektu «Monitoring studencheskikh kharakteristik i traektorii» [Project Report «Monitoring of Student Characteristics and Trajectories»], Moscow, Higher School of Economics, 2014, 70 p. (In Russ.).
72. Maloshonok N. G. Kak vospriyatie akademicheskoi chestnosti sredy universiteta vzaimosvyazano so studencheskoi vovlechennost’yu: vozmozhnosti kontseptualizatsii i empiricheskogo izucheniya [How Perception of Academic Honesty at the University Linked with Student Engagement: Conceptualization and Empirical Research Opportunities]. Voprosy obrazovaniya, 2016, no. 1, pp. 35–60. doi 10.17323/1814-9545-2016-1-35-60. (In Russ.).
73. Agapova E. N. Rol’ studencheskogo samoupravleniya kak sotsial’nogo instituta v povyshenii kachestva vysshego obrazovaniya [The Role of Student Government as a Social Institution in Improving the Quality of Higher Education]. Evraziiskii soyuz uchenykh, 2015, no. 7-7 (16), pp. 56–58. (In Russ.).
74. Duka N. A., Stovba A. A. Ob issledovanii vovlechennosti studentov pedagogicheskogo universiteta v obrazovatel’nyi protsess [On the Problem of Pedagogical University Students’ Involvement Research]. Vestnik Omskogo gosudarstvennogo pedagogicheskogo universiteta. Gumanitarnye issledovaniya, 2016, no. 3 (12), pp. 85–87. (In Russ.).
75. Savinova S. Yu. Vovlechennost’ studentov v obrazovatel’nyi protsess: otsenka pozitivnykh effektov [Engagement of Students in the Educational Process: Estimation of Positive Effects]. Chelovek i obrazovanie, 2015, no. 4 (45), pp. 143–147. (In Russ.).
76. Soboleva E. N. Vovlechennost’ studentov v uchebno-issledovatel’skuyu rabotu dlya usvoeniya ubezhdenii i norm akademicheskoi deyatel’nosti [Involvement of Students in Teaching and Research Work for the Assimilation of Beliefs and Norms of Academic Activity]. In: O. B. Alekseev, E. V. Galazhinsky, A. O. Zotkin (Eds.), Upravlenie talantami i transformatsiya korporativnoi kul’tury, Tomsk, 2016, pp. 230–233. (In Russ.).
77. Hatskevich T. A. Aktivizatsiya professional’no-obrazovatel’noi vovlechennosti budushchikh bakalavrov sotsial’no-gumanitarnogo profilya v usloviyakh internatury [Activation of Professional and Education Involvement among Future Bachelors of Social and Humanitarian Profile in the Internship]. Sovremennye issledovaniya sotsial’nykh problem (elektronnyi nauchnyi zhurnal), 2016, no. 10, pp. 136–144. doi 10.12731/2218-7405-2016-10-136-144. (In Russ.).
78. Karabchuk T., Roshchina Y. Predictors of Student Engagement: The Role of Universities’ or Importance of Students’ Background? European Journal of Higher Education, 2022, February, 3, pp. 1–20. doi 10.1080/21568235.2022.2035240. (In Eng.).
79. Shcheglova I. Can Student Engagement in Extracurricular Activities Facilitate the Development of Their Soft Skills? Monitoring obshchestvennogo mneniya: ekonomichekie i sotsial’nye peremeny, 2019, no. 6 (154), pp. 111–121. doi 10.14515/monitoring.2019.6.07. (In Eng.).
80. Maloshonok N. G., Vilkova K. A. Izmerenie uchebnoi vovlechennosti studentov kak instrument otsenki kachestva rossiiskogo vysshego obrazovaniya [Measuring Student Engagement as a Tool for Assessing the Quality of Russian Higher Education], iss. 7 (24), Moscow, Higher School of Economics, 2022, 46 p. (In Russ.).
81. Maloshonok N. Harm Not Only Females: Math-Gender Stereotypes and Engagement of Engineering Students at Russian Universities. European Journal of Engineering Education, 2022, vol. 47, no. 6, pp. 1197–1215. doi 10.1080/03043797.2022.2134760. (In Eng.).
82. Maloshonok N., Shcheglova I., Zhuchkova S. Undergraduates’ Orientations towards Student–University Relationships: Measurement and Associations with Student Characteristics and Engagement. Higher Education Quarterly, 2023, March, 21, pp. 1–18. doi 10.1111/hequ.12430. (In Eng.).
83.
Review
For citations:
Maloshonok N.G. Student Engagement as an Instrument of Assessing the Quality of Education in Russian Universities. University Management: Practice and Analysis. 2023;27(2):45-58. (In Russ.) https://doi.org/10.15826/umpa.2023.02.012
Views:
851
Email this article 