Investigating The Validity, Reliability And Standardization Of The Global Competence Questionnaire Of Graduate Students

Document Type : Original Article

Authors

Consulting Department, Mohaghegh Ardabili University. Ardabil - Iran.

Abstract

Introduction: Global competence has profoundly affected all areas of education. In the process of globalization, global competence is a critical competence for graduate students. The Graduate Student Global Competence Questionnaire (GCSG) is a new tool for measuring the global competency of university graduate students. The aim of the present study was to investigate the validity, reliability and standardization of the Global Competence Questionnaire of university graduates in the Iranian student community.
Method: The present research method was correlational and 234 graduate students of different universities in the country at the master's and doctoral level were selected by available sampling method and the global competence questionnaire of graduate students that was first used by Liu, Yin, and Wu (2020) have designed, they answered.
Results: The results of data analysis using Pearson's correlation coefficient and confirmatory factor analysis showed that the GCSG scale, like the original form, consists of three main factors of knowledge and understanding, skills, and attitudes and values, with Cronbach's alpha coefficients for the subscales of skills, attitudes and values, and knowledge and understanding are 0.89, 0.82, and 0.82, respectively, and have the required validity of 0.92 for the whole scale. On the other hand, because the correlation coefficients of the sub-scales show a lower value compared to the correlation coefficients of the total scale, it indicates the validity of the measurement scale. The indices obtained from the fitted model CMIN/DF, CFI, GFI, and RMSEA were 1.60, 0.90, 0.82, and 0.55, respectively, with DF = 468, which is at the level of (p< 0.001) is significant and shows the acceptability of the fitted model.
Discussion and Conclusion: It is concluded that the current scale is a reliable and valid tool for measuring the global competence of university graduates and by using the current tool, extensive research can be done in line with the global competence of students and also the effectiveness of various programs in this field.

Keywords


1- Ping, Xiaomei. Wang, Junxiang. Zhang, Danhong. Wang, Jingying. (2023). The Research Landscape of Global Competence: Theory Development, Research Focus and Prospects, Journal of Science Education, 24(1), ISSN 0124-5481.
 2-  Moskal, M., & Schweisfurth, M. (2018). Learning, using and exchanging global competence in the context of international postgraduate mobility. Globalisation Societies and Education, 16(1), 93–105.
3- Liu, Yang,. Yin, Yue. Wu, Ruilin. (2020). Measuring graduate students’ global competence: Instrument development and an empirical study with a Chinese sample. Studies in Educational Evaluation, 67,100915.
4-  Hunter, Bill. White, George P. Godbey, Galen C. (2006). What Does It Mean to Be Globally Competent? Journal of Studies in International Education, Vol. 10 No. 3, 267-285.
5- Dimitrov, N., Dawson, D. L., Olsen, K. C., & Meadows, K. N. (2014). Developing the intercultural competence of graduate students. Canadian Journal of Higher Education, 44(3), 86–103.
6- Bolívar-Cruz, Alicia. Verano-Tacoronte, Domingo. (2018). Self-assessment of the oral presentation competence: Effects of gender and student’s performance. Studies in Educational Evaluation. 59: 94–101.
7- Hunter, B., White, G. P., & Godbey, G. C. (2006). What does it mean to be globally competent. Journal of Studies in International Education, 10(3), 267–285.
8- Flammia, M., Sadri, H., & Mejia, C. (2019). An internalization project to develop global competency across the disciplines. International Journal of Teaching and Learning in Higher Education, 31(2), 332–345.
9- Bennett, R. J., Volet, S. E., & Fozdar, F. E. (2013). “I’d say it’s kind of unique in a way”: The development of an intercultural student relationship. Journal of Studies in International Education, 17(5), 533–553.
10- Curran, K. (2003). Global competencies that facilitate working effectively across cultures. Retrieved July 14, from http://content.monster.com.sg/ management/5808.
11- Huttner-Koros, A. (2015). Why science’s universal language is a problem for research. Retrieved. fromhttp://www.theatlantic.com/science/archive/ 2015/08/ English universal- language-science-research/400919/.
12- Weijen, D. (2012). The language of (future) scientific communication. Retrieved fromResearch Trends. https://www.researchtrends.com/issue-31-november-2012/ the-language-of-future-scientific-communication/
13- Pyne, R., Dinwoodie, J., & Roe, M. (2007). Enhancing the intercultural competence of postgraduate logisticians. International Journal of Logistics: Research and Applications, 10(3), 221–233.
14- Feast, V. (2002). The impact of IELTS scores on performance at university. International Education Journal, 3(4), 70–85.
15- Braxley, K. (2005). Mastering academic English: International graduate students‟ use of dialogue and speech genres to meet the writing demands of graduate school. In K. H. Hall, G. Vitanova, & L. Marchenkova (Eds.). Dialogue with Bakhtin on second and foreign language learning (pp. 11-32). New Jersey: Lawrence Erlbaum Associates.
16- Li, Y. (2007). Apprentice scholarly writing in a community of practice: An intraview of an NNES graduate student writing a research article. TESOL Quarterly, 41, 1, 55-79.
17- Griffith, R. L., Wolfeld, L., Armon, B. K., Rios, J., & Liu, O. L. (2016). Assessing intercultural competence in higher education: Existing research and future directions (23308516). Retrieved from https://doi.org/10.1002/ets2.12112.
18- Fantini, A. E. (2009). Assessing intercultural competence: Issues and tools. In D. K. Deardorff (Ed.). The SAGE handbook of intercultural competence (pp. 456–476). Thousand Oaks, CA: SAGE Publications.
19- OECD. (2018). Preparing our youth for an inclusive and sustainable world: The OECD PISA Global Competence Framework. Paris: OECD Publishing.
20- Hunter, W. D. (2004). Knowledge, skills, attitudes, and experiences necessary to become globally competent. ProQuest Dissertations Publishing.
21- Sun, Cheng. (2021). Future-oriented global competency education: review and reflection. Chongqing Higher Education Research, 9(04), 118-127.
22- Tang, L., & Yang,Y. (2019). Study on the Development Path of Global Competence Education in China-Upon Understanding the Present Situation of Global Competence Education. Studies in Foreign Education, 46(04), 91-102.
23- Zhou, S. (2017). Global Age Calls for Global Competence Education. Global Education, 46(09),2.
24- Teng, J., Zhang,T., & Hu,J. (2018). Preparing Students with "Global Competence"-The New Idea of American International Education and Its Critical Reflection in China. Educational Research, 39(01), 142-147
25- Exchange, C., York, N., & NY. (1993). Educational Exchange and Global Competence. International Conference on Educational Exchange (46th), Washington, D.C., November 1993).
26- Chandir, H. (2022). Student responses on the survey of global competence in PISA 2018. Discourse: Studies in the Cultural Politics of Education, 43(4), 526-542.
27- Engel, L. C., Rutkowski, D., & Thompson, G. (2019). Toward an international measure of global competence? A critical look at the PISA 2018 framework. Globalisation Societies and Education, 17(4), 1-15.
28- Simpson, A., & Dervin, F. (2019). Global and intercultural competences for whom? By whom? For what purpose? an example from the Asia Society and the OECD. Compare., 49(4), 1-6.
29- Pei-I, C., Ya-Ting, W., & Shu-Ting, W. (2019). Content analysis of core concepts of global competence in junior high school English textbooks in Taiwan: Taking the content domains of the cognitive tests in the PISA 2018 global competence assessment as a framework ER -. Jiao ke shu yan jiu, 12(1), 1.
30- Cheng, X. (2021). Research on Global competency Content in High School English Textbooks Published by People's Education Press-Based on "The OECD PISA global competence framework". Master Dissertation, Yangtze University,Hubei,China.https://kns.cnki.net/kcms/detail/detail.aspx?FileName=1022004283.nh&DbName=CMFD2022.
31- Liu, Y. (2022). Research on the Global Competence Educational Content in English Textbooks of the People's Education Press for Junior High School. Master Dissertation, JiangnanUniversity,Jiangsu,China.https://kns.cnki.net/kcms/detail/detail.aspx?FileName=1022641103.nh&DbName=CMFD2023
32- Liikamaa, K. (2015). Developing a project manager’s competencies: A collective view of the most important competencies. Procedia Manufacturing, 3, 681-687.
33- Demetry, Chrysanthe,. Vaz, Richard, F. (2017). Influence of an Education Abroad Program on the Intercultural Sensitivity of STEM Undergraduates: A Mixed Methods Study. Advances in Engineering Education: 1-32.
34- Jiang, L., & Alexakis, G. (2017). Comparing students' and managers' perceptions of essential 881/12/1entry-level management competencies in the hospitality industry: An empirical stud03/1y. Journal of Hospitality, Leisure, Sport & Tourism Education, 20, 32-46.
35-  Hwang, H., & Kuo, T. (2018). Competency in delivering health education: A concept analysis. Journal of Interprofessional Education & Practice, 11, 20-25.
36- Ston B. Y. (2004). extension and success: A competency-based professional development system. J Ext. 42(2):1.
37- Zook, A. (2006). Military competency-based human capital management: A step toward the future. USA Carlisle: Army War College, Carlisle Barracks.
38- Swiss Consulting Group. (2002). Global competence report. Zurich, Germany: Author.
39- Hunter, Bill. White, George P. Godbey, Galen C. (2006). What Does It Mean to Be Globally Competent? Journal of Studies in International Education, 10(3): 267-285.
40- Elmer, M. I. (1987). Intercultural effectiveness: Development of an intercultural competency scale. (Unpublished Doctoral Dissertation). East Lansing, MI: Michigan State University.
41- Pruegger, V. J., & Rogers, T. B. (1993). Development of a scale to measure cross-cultural sensitivity in the Canadian context. Canadian Journal of Behavioural Science, 25(4), 615–621.
42- Matsumoto, D., LeRoux, J., Ratzlaff, C., Tatani, H., Uchida, H., Kim, C., & Araki, S. (2001). Development and validation of a measure of intercultural adjustment potential in Japanese sojourners: The intercultural adjustment potential scale (ICAPS). International Journal of Intercultural Relations, 25(5), 483–510.
43- Olson, C. L., & Kroeger, K. R. (2001). Global competency and intercultural sensitivity. Journal of Studies in International Education, 5(2), 116–137.
44- Van der Zee, K. I., & Van Oudenhoven, J. P. (2001). The multicultural personality questionnaire: Reliability and validity of self- and other ratings of multicultural effectiveness. Journal of Research in Personality, 35(3), 278–288.
45- Earley, P. C., & Ang, S. (2003). Cultural intelligence: Individual interactions across cultures. Stanford, CA: Stanford University Press.
46- Deardorff, D. K. (2006). Identification and assessment of intercultural competence as a student outcome of internationalization. Journal of Studies in International Education, 10(3), 241–266.
47- Brookes, M., & Becket, N. (2011). Developing global perspectives through international management degrees. Journal of Studies in International Education, 15(4), 374–394.
48- Morais, D. B., & Ogden, A. C. (2011). Initial development and validation of the global citizenship scale. Journal of Studies in International Education, 15(5), 445–466.
49- Nanda Dimitrov, Debra L. Dawson, Karyn C. Olsen, Ken N. Meadows. (2014). Developing the Intercultural Competence of Graduate Students, Canadian Journal of Higher Education, V 44, N. 3, 86 – 103.
50- Siczek, Megan M. (2015). Developing Global Competency in US Higher Education: Contributions of International Students, The CATESOL Journal, 27(2), 5-21.
51- Zheng, Min. (2015). Intercultural Competence in Intercultural Business Communication, Open Journal of Social Sciences, 3, 197-200.
52- Sälzer, C. and Roczen, N. (2018) ‘Die Messung von Global Competence im Rahmen von PISA 2018’. Zeitschrift für Erziehungswissenschaft 21 (2): 299–316.
53-  Klarin, Anton. Inkizhinov, Boris. Nazarov, Dashi. Gorenskaia, Elena. (2020). International business education: What we know and what we have yet to develop. International Business Review, 1-16.
54- Rezaei Sharif, Ali. (2014). Confirmatory factor analysis of the tendency towards critical thinking scale in students, Thought and Child Research Institute of Human Sciences and Cultural Studies, 6(1), 45-60. (Persian).
55- Homan, Heydar Ali. (2007). Psychological and educational measurements (technique of preparing tests and questionnaires), Tehran: Parsa Publishing. (Persian).
56-Nazari, Javad.; and Mokhtaripour, Marzieh. (2009). Factor analysis and its application in social sciences, Monthly Book of Social Sciences, 14(122), 20-33. (Persian).
58- Shasti, Samaneh (2010). Competency-Based Education, Journal of Education Strategies, 3(2), 77-80. (Persian).  
59- Lunn, J. (2008). Global perspectives in higher education: Taking the agenda forward in the United Kingdom. Journal of Studies in International Education, 12, 231-254.
60- Gacel-Avila, J. (2005). The internationalisation of higher education: A paradigm for global citizenry. Journal of Studies in International Education, 9, 121-136.
61- Erll, A., & Gymnich, M. (2015). Interkulturelle Kompetenzen- Erfolgreich kommunizieren zwischen den Kulturen [Intercultural Competencies- Successfully Communicating Across Cultures] (3rd ed.). Stuttgart, Germany: Klett.
62-  Bennett, R. J., Volet, S. E., & Fozdar, F. E. (2013). “I’d say it’s kind of unique in a way”: The development of an intercultural student relationship. Journal of Studies in International Education, 17(5), 533–553.
63- Bosse, E. (2010). Interkulturelle Qualifizierungsangebote fur Studierende: mehrstufig, studienbegleitend und nachhaltig [Intercultural qualification offers for students: Multilevel, study-related and sustainable]. In O. Eß (Ed.), Das Andere Lehren. Handbuch zur Lehre Interkultureller Handlungskompetenz [Teaching the Other: Handbook on Teaching Intercultural Competence] (pp. 35–47). Munster, Germany: Waxmann.  
64- Harrison, N., & Peacock, N. (2009). Cultural distance, mindfulness and passive xenophobia: Using Integrated Threat Theory to explore home higher education students’ perspectives on “internationalisation at home.” British Educational Research Journal, 36(6), 877–902.
65- Schaetti, B. F., Ramsey, S. J., & Watanabe, G. C. (2009). From intercultural knowledge to intercultural competence: Developing an intercultural practice. In M. A. Moodian (Ed.), Contemporary Leadership and Intercultural Competence: Understanding and Utilizing Cultural Diversity to Build Successful Organizations (pp. 125–138). Thousand Oaks, USA: SAGE.
66- Ledger, S., Thier, M., Bailey, L., & Pitts, C. (2019). OECD's Approach to Measuring Global Competency: Powerful Voices Shaping Education. TEACHERS COLLEGE RECORD, 121(8).
67- Mansilla, V. B., & Wilson, D. (2020). What is Global Competence, and What Might it Look Like in Chinese Schools? Journal of Research in International Education, 19(1), 3-22.
68- Carr, G. (2012). Graduate students need preparation for life outside the university. The Globe and Mail. Retrieved from http://www.theglobeandmail. com/news/national/graduate-students-need-preparation-for-life-outside-university/ article4699319.
69- Stein, S. (2015). Mapping Global Citizenship ER -. Journal of college and character, 16(4), 242-252.