Development and validation of the performance environment of practice scale
Article Sidebar
Main Article Content
Abstract
The performance climate is affected by time, situation, and case, which requires frequent measurement within practice environments where athletes spend most of their time. This study aimed to develop and validate the Performance Environment of Practice Scale (PEPS). Three waves of data collection and analysis were conducted: content validity (n = 30), exploratory factor analysis (n = 389), and confirmatory factor analysis (n = 198). The scale development process provided initial evidence for the face validity and internal reliability of the 7-factor 26-item PEPS for use with athletes in a competitive practice environment. The PEPS provides a performance environment measure that carries lower response burden than previous measurement attempts. The PEPS can be used by coaches at regular intervals to measure the psychological performance climate of their practice environment. Further evaluation of the test-retest reliability and predictive validity of the PEPS is required, along with accuracy assessments against coach performance perceptions and the gathering of normative data.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
References
Andreassen, C. S., Torsheim, T., Brunborg, G. S., & Pallesen, S. (2012). Development of a Facebook addiction scale. Psychological Reports, 110(2), 501-517. https://doi.org/10.2466/02.09.18.PR0.110.2.501-517 DOI: https://doi.org/10.2466/02.09.18.PR0.110.2.501-517
Arnold, R., & Fletcher, D. (2012). A research synthesis and taxonomic classification of the organizational stressors encountered by sport performers. Journal of Sport and Exercise Psychology, 34(3), 397-429. https://doi.org/10.1123/jsep.34.3.397 DOI: https://doi.org/10.1123/jsep.34.3.397
Baker, J., Horton, S., Robertson-Wilson, J., & Wall, M. (2003). Nurturing sport expertise: factors influencing the development of elite athlete. Journal of Sports Science & Medicine, 2(1), 1-9. https://doi.org/10.1016/S1440-2440(01)80002-5 DOI: https://doi.org/10.1016/S1440-2440(01)80002-5
Baumeister, R. F., Vohs, K. D., DeWall, C. N., & Zhang, L. (2007). How emotion shapes behaviour: Feedback, anticipation, and reflection, rather than direct causation. Personality and Social Psychology Review, 11(2), 167-203. https://doi.org/10.1177/1088868307301033 DOI: https://doi.org/10.1177/1088868307301033
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: a primer. Frontiers in Public Health, 6, 149. https://doi.org/10.3389/fpubh.2018.00149 DOI: https://doi.org/10.3389/fpubh.2018.00149
Brink, M. S., Kuyvenhoven, J. P., Toering, T., Jordet, G., & Frencken, W. G. (2018). What do football coaches want from sport science?. Kinesiology, 50(1), 150-154.
Brown, H. E., Lafferty, M. E., & Triggs, C. (2015). In the face of adversity: Resiliency in winter sport athletes. Science & Sports, 30(5), e105-e117. https://doi.org/10.1016/j.scispo.2014.09.006 DOI: https://doi.org/10.1016/j.scispo.2014.09.006
Buch, R., Nerstad, C. G., & Säfvenbom, R. (2017). The interactive roles of mastery climate and performance climate in predicting intrinsic motivation. Scandinavian Journal of Medicine & Science in Sports, 27(2), 245-253. https://doi.org/10.1111/sms.12634 DOI: https://doi.org/10.1111/sms.12634
Carpenter, S. (2018). Ten steps in scale development and reporting: A guide for researchers. Communication Methods and Measures, 12(1), 25-44. https://doi.org/10.1080/19312458.2017.1396583 DOI: https://doi.org/10.1080/19312458.2017.1396583
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233-255. https://doi.org/10.1207/S15328007SEM0902_5 DOI: https://doi.org/10.1207/S15328007SEM0902_5
Chou, C.-P., & Bentler, P. M. (1995). Estimates and tests in structural equation modeling. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 37-55). Sage Publications, Inc.
Comrey, A. L., & Lee, H. B. (2013). A first course in factor analysis. Psychology Press. https://doi.org/10.4324/9781315827506 DOI: https://doi.org/10.4324/9781315827506
DeVellis, R.F. & Thorpe, C.T. (2022). Scale development: Theory and applications. 5th ed.) Sage publications.
Douglas, K. & Carless, D. (2006). Performance environment research: Research report. London: UK Sport Performance Environment Research.
Duignan, C., Doherty, C., Caulfield, B., & Blake, C. (2020). Single-item self-report measures of team-sport athlete wellbeing and their relationship with training load: A systematic review. Journal of Athletic Training, 55(9), 944-953. https://doi.org/10.4085/1062-6050-0528.19 DOI: https://doi.org/10.4085/1062-6050-0528.19
Durand-Bush, N., & Salmela, J. H. (2002). The development and maintenance of expert athletic performance: Perceptions of world and Olympic champions. Journal of Applied Sport Psychology, 14(3), 154-171. https://doi.org/10.1080/10413200290103473 DOI: https://doi.org/10.1080/10413200290103473
Eisele, G., Vachon, H., Lafit, G., Kuppens, P., Houben, M., Myin-Germeys, I., & Viechtbauer, W. (2022). The effects of sampling frequency and questionnaire length on perceived burden, compliance, and careless responding in experience sampling data in a student population. Assessment, 29(2), 136-151. https://doi.org/10.1177/1073191120957102 DOI: https://doi.org/10.1177/1073191120957102
Ericsson, K. A. (2020). Towards a science of the acquisition of expert performance in sports: Clarifying the differences between deliberate practice and other types of practice. Journal of Sports Sciences, 38(2), 159-176. https://doi.org/10.1080/02640414.2019.1688618 DOI: https://doi.org/10.1080/02640414.2019.1688618
Ericsson, K. A., Krampe, R. T., & Tesch-Römer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100(3), 363-406. https://doi.org/10.1037/0033-295X.100.3.363 DOI: https://doi.org/10.1037/0033-295X.100.3.363
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272-299. https://doi.org/10.1037/1082-989X.4.3.272 DOI: https://doi.org/10.1037/1082-989X.4.3.272
Feltz, D. L., Short, S. E., & Sullivan, P. J. (2008). Self-efficacy in Sport. Human Kinetics. https://doi.org/10.5040/9781718206625 DOI: https://doi.org/10.5040/9781718206625
Fisher, R., Maritz, A., & Lobo, A. (2014). Evaluating entrepreneurs' perception of success: Development of a measurement scale. International Journal of Entrepreneurial Behavior & Research, 20(5), 478-492. https://doi.org/10.1108/IJEBR-10-2013-0157 DOI: https://doi.org/10.1108/IJEBR-10-2013-0157
Flake, J. K., & Fried, E. I. (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science, 3(4), 456-465. https://doi.org/10.1177/2515245920952393 DOI: https://doi.org/10.1177/2515245920952393
Fletcher, D., Hanton, S., Mellalieu, S. D., & Neil, R. (2012). A conceptual framework of organizational stressors in sport performers. Scandinavian Journal of Medicine & Science in Sports, 22(4), 545-557. https://doi.org/10.1111/j.1600-0838.2010.01242.x DOI: https://doi.org/10.1111/j.1600-0838.2010.01242.x
Fletcher, D., & Streeter, A. (2016). A case study analysis of a high performance environment in elite swimming. Journal of Change Management, 16(2), 123-141. https://doi.org/10.1080/14697017.2015.1128470 DOI: https://doi.org/10.1080/14697017.2015.1128470
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50. https://doi.org/10.2307/3151312 DOI: https://doi.org/10.1177/002224378101800104
Furnham, A. (2012). Culture at work. In A. Furnham (Ed), The psychology of behaviour at work: The individual in the organization. Psychology Press. https://doi.org/10.4324/9780203506974 DOI: https://doi.org/10.4324/9780203506974
Galesic, M., & Bosnjak, M. (2009). Effects of questionnaire length on participation and indicators of response quality in a web survey. Public Opinion Quarterly, 73(2), 349-360. https://doi.org/10.1093/poq/nfp031 DOI: https://doi.org/10.1093/poq/nfp031
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis (7th ed.). Prentice-Hall.
Hardy, L., Jones, J. G., & Gould, D. (1996). Understanding psychological preparation for sport: Theory and practice of elite performers. John Wiley & Sons Inc.
Harrington, D. (2009). Confirmatory factor analysis. Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195339888.001.0001 DOI: https://doi.org/10.1093/acprof:oso/9780195339888.001.0001
Harwood, C. G., Keegan, R. J., Smith, J. M., & Raine, A. S. (2015). A systematic review of the intrapersonal correlates of motivational climate perceptions in sport and physical activity. Psychology of Sport and Exercise, 18, 9-25. https://doi.org/10.1016/j.psychsport.2014.11.005 DOI: https://doi.org/10.1016/j.psychsport.2014.11.005
Harwood, C. G., & Thrower, S. N. (2020). Motivational climate in youth sport groups. In M.W. Bruner, M.A. Eys & L.J. Martin (Eds). The power of groups in youth sport (pp. 145-163). Academic Press. https://doi.org/10.1016/B978-0-12-816336-8.00009-3 DOI: https://doi.org/10.1016/B978-0-12-816336-8.00009-3
Hodge, K., Henry, G., & Smith, W. (2014). A case study of excellence in elite sport: Motivational climate in a world champion team. The Sport Psychologist, 28(1), 60-74. https://doi.org/10.1123/tsp.2013-0037 DOI: https://doi.org/10.1123/tsp.2013-0037
Hoe, S. L. (2008). Issues and procedures in adopting structural equation modelling technique. Journal of Quantitative Methods, 3(1), 76.
Horvath, S., & Röthlin, P. (2018). How to improve athletes' return of investment: Shortening questionnaires in the applied sport psychology setting. Journal of Applied Sport Psychology, 30(2), 241-248. https://doi.org/10.1080/10413200.2017.1382020 DOI: https://doi.org/10.1080/10413200.2017.1382020
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. https://doi.org/10.1080/10705519909540118 DOI: https://doi.org/10.1080/10705519909540118
Humble, S. (2020). Quantitative analysis of questionnaires: Techniques to explore structures and relationships. Routledge. https://doi.org/10.4324/9780429400469 DOI: https://doi.org/10.4324/9780429400469
Ingrell, J., Johnson, U., & Ivarsson, A. (2016). Relationships between ego-oriented peer climate, perceived competence and worry about sport performance: A longitudinal study of student-athletes. Sport Science Review, 25(3-4), 225-242. https://doi.org/10.1515/ssr-2016-0012 DOI: https://doi.org/10.1515/ssr-2016-0012
James, L. R., & Sells, S. B. (2013). Psychological climate: Theoretical perspectives and empirical research. In D. Magnusson (Ed.), Toward a psychology of situations: An interactional perspective (pp. 285-306). Psychology Press.
Jarvis, C. B., MacKenzie, S. B., & Podsakoff, P. M. (2003). A critical review of construct indicators and measurement model misspecification in marketing and consumer research. Journal of Consumer Research, 30(2), 199-218. https://doi.org/10.1086/376806 DOI: https://doi.org/10.1086/376806
Jones, G., Gittins, M., & Hardy, L. (2009). Creating an environment where high performance is inevitable and sustainable: The high performance environment model. Annual Review of High Performance Coaching and Consulting, 1, 139-149. https://doi.org/10.1260/ijssc.4.suppl-2.671q532j757771rl DOI: https://doi.org/10.1260/ijssc.4.suppl-2.671q532j757771rl
Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31-36. https://doi.org/10.1007/BF02291575 DOI: https://doi.org/10.1007/BF02291575
Kaiser, H. F., & Rice, J. (1974). Little Jiffy, Mark Iv. Educational and Psychological Measurement, 34(1), 111-117. https://doi.org/10.1177/001316447403400115 DOI: https://doi.org/10.1177/001316447403400115
Kline, P. (2000). Handbook of psychological testing. Psychology Press. https://doi.org/10.4324/9781315812274 DOI: https://doi.org/10.4324/9781315812274
Koster, J., & Aven, B. (2018). The effects of individual status and group performance on network ties among teammates in the National Basketball Association. PloS ONE, 13(4): e0196013. https://doi.org/10.1371/journal.pone.0196013 DOI: https://doi.org/10.1371/journal.pone.0196013
Laborde, S., Guillén, F., & Watson, M. (2017). Trait emotional intelligence questionnaire full-form and short-form versions: Links with sport participation frequency and duration and type of sport practiced. Personality and Individual Differences, 108, 5-9. https://doi.org/10.1016/j.paid.2016.11.061 DOI: https://doi.org/10.1016/j.paid.2016.11.061
Lacerda, A., Filgueiras, A., Campos, M., Keegan, R., & Landeira-Fernández, J. (2021). Motivational Climate Measures in Sport: A Systematic Review. The Spanish Journal of Psychology, 24, E27. https://doi.org/10.1017/SJP.2021.13 DOI: https://doi.org/10.1017/SJP.2021.13
Lamm, K. W., Lamm, A. J., & Edgar, D. (2020). Scale development and validation: Methodology and recommendations. Journal of International Agricultural and Extension Education, 27(2), 24-35. https://doi.org/10.4148/2831-5960.1115 DOI: https://doi.org/10.5191/jiaee.2020.27224
Lazarus, R. S. (1991). Progress on a cognitive-motivational-relational theory of emotion. American Psychologist, 46(8), 819-834. https://doi.org/10.1037/0003-066X.46.8.819 DOI: https://doi.org/10.1037/0003-066X.46.8.819
Lazarus, R. S., & Folkman, S. (1984). Stress, appraisal, and coping. Springer.
MacKenzie, S. B., Podsakoff, P. M., & Podsakoff, N. P. (2011). Construct measurement and validation procedures in MIS and behavioral research: Integrating new and existing techniques. MIS Quarterly 35(2), 293-334. https://doi.org/10.2307/23044045 DOI: https://doi.org/10.2307/23044045
Mackinnon, S. P., & Wang, M. (2020). Response-Order Effects for Self-report Questionnaires: Exploring the role of Overclaiming Accuracy and Bias. Journal of Articles in Support of the Null Hypothesis, 16(2).
Macnamara, B. N., Hambrick, D. Z., & Oswald, F. L. (2014). Deliberate practice and performance in music, games, sports, education, and professions: A meta-analysis. Psychological Science, 25(8), 1608-1618. https://doi.org/10.1177/0956797614535810 DOI: https://doi.org/10.1177/0956797614535810
Mellalieu, S. D., Neil, R., Hanton, S., & Fletcher, D. (2009). Competition stress in sport performers: Stressors experienced in the competition environment. Journal of Sports Sciences, 27(7), 729-744. https://doi.org/10.1080/02640410902889834 DOI: https://doi.org/10.1080/02640410902889834
Mills, A., Butt, J., Maynard, I., & Harwood, C. (2012). Identifying factors perceived to influence the development of elite youth football academy players. Journal of Sports Sciences, 30(15), 1593-1604. https://doi.org/10.1080/02640414.2012.710753 DOI: https://doi.org/10.1080/02640414.2012.710753
Morgado, F. F., Meireles, J. F., Neves, C. M., Amaral, A., & Ferreira, M. E. (2017). Scale development: ten main limitations and recommendations to improve future research practices. Psicologia: Reflexão e Crítica 30(3). https://doi.org/10.1186/s41155-016-0057-1 DOI: https://doi.org/10.1186/s41155-016-0057-1
Muthén, B., & Kaplan, D. (1985). A comparison of some methodologies for the factor analysis of non-normal Likert variables. The British Journal of Mathematical and Statistical Psychology, 38(2), 171-189. https://doi.org/10.1111/j.2044-8317.1985.tb00832.x DOI: https://doi.org/10.1111/j.2044-8317.1985.tb00832.x
Myers, N. D., Pacewicz, C. E., Hill, C. R., & Chun, H. (2023). Factor analysis with ordered categorical indicators and measurement of self-efficacy in physical activity contexts: A substantive-methodological synergy. Measurement in Physical Education & Exercise Science, 4(27). 332-351. https://doi.org/10.1080/1091367X.2023.2186789 DOI: https://doi.org/10.1080/1091367X.2023.2186789
Neil, R., Fletcher, D., Hanton, S., & Mellalieu, S. D. (2007). (Re)conceptualizing competition stress in sport performers. Sport and Exercise Psychology Review, 3, 23-29. https://doi.org/10.53841/bpssepr.2007.3.2.23 DOI: https://doi.org/10.53841/bpssepr.2007.3.2.23
Newton, M., Duda, J. L., & Yin, Z. (2000). Examination of the psychometric properties of the Perceived Motivational Climate in Sport Questionnaire-2 in a sample of female athletes. Journal of Sports Sciences, 18(4), 275-290. https://doi.org/10.1080/026404100365018 DOI: https://doi.org/10.1080/026404100365018
Ng, M. M., Firth, J., Minen, M., & Torous, J. (2019). User engagement in mental health apps: a review of measurement, reporting, and validity. Psychiatric Services, 70(7), 538-544. https://doi.org/10.1176/appi.ps.201800519 DOI: https://doi.org/10.1176/appi.ps.201800519
Nicholls, J. G. (1984). Achievement motivation: Conceptions of ability, subjective experience, task choice, and performance. Psychological Review, 91(3), 328-346. https://doi.org/10.1037/0033-295X.91.3.328 DOI: https://doi.org/10.1037/0033-295X.91.3.328
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill.
O'Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test. Behavior Research Methods, Instrumentation, and Computers, 32, 396-402. https://doi.org/10.3758/BF03200807 DOI: https://doi.org/10.3758/BF03200807
Pain, M. A., & Harwood, C. (2007). The performance environment of the England youth soccer teams. Journal of Sports Sciences, 25(12), 1307-1324. https://doi.org/10.1080/02640410601059622 DOI: https://doi.org/10.1080/02640410601059622
Pain, M. A., & Harwood, C. G. (2008). The performance environment of the England youth soccer teams: A quantitative investigation. Journal of Sports Sciences, 26(11), 1157-1169. https://doi.org/10.1080/02640410802101835 DOI: https://doi.org/10.1080/02640410802101835
Pain, M. A., Harwood, C., & Mullen, R. (2012). Improving the performance environment of a soccer team during a competitive season: An exploratory action research study. The Sport Psychologist, 26(3), 390-411. https://doi.org/10.1123/tsp.26.3.390 DOI: https://doi.org/10.1123/tsp.26.3.390
Pensgaard, A. M., & Duda, J. L. (2002). "If we work hard, we can do it" a tale from an Olympic (gold) medalist. Journal of Applied Sport Psychology, 14(3), 219-236. https://doi.org/10.1080/10413200290103518 DOI: https://doi.org/10.1080/10413200290103518
Pett, M. A., Lackey, N. R., & Sullivan, J. J. (2003). Making sense of factor analysis: The use of factor analysis for instrument development in health care research. Sage. https://doi.org/10.4135/9781412984898 DOI: https://doi.org/10.4135/9781412984898
Raykov, T., & Marcoulides, G. A. (2011). Introduction to psychometric theory. Routledge. https://doi.org/10.4324/9780203841624 DOI: https://doi.org/10.4324/9780203841624
Rolstad, S., Adler, J., & Rydén, A. (2011). Response burden and questionnaire length: is shorter better? A review and meta-analysis. Value in Health, 14(8), 1101-1108. https://doi.org/10.1016/j.jval.2011.06.003 DOI: https://doi.org/10.1016/j.jval.2011.06.003
Roseman, I. J., & Smith, C. A. (2001). Appraisal theory. In K.R. Scherer, A. Schorr & T. Johnstone (Eds). Appraisal processes in emotion: Theory, methods, research (pp. 3-19). Oxford University Press. https://doi.org/10.1093/oso/9780195130072.003.0001 DOI: https://doi.org/10.1093/oso/9780195130072.003.0001
Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1-36. https://doi.org/10.18637/jss.v048.i02 DOI: https://doi.org/10.18637/jss.v048.i02
Simms, M., Arnold, R., Turner, J. E., & Hays, K. (2021). A repeated-measures examination of organizational stressors, perceived psychological and physical health, and perceived performance in semi-elite athletes. Journal of Sports Sciences, 39(1), 64-77. https://doi.org/10.1080/02640414.2020.1804801 DOI: https://doi.org/10.1080/02640414.2020.1804801
Smith, A. L. (2003). Peer relationships in physical activity contexts: A road less travelled in youth sport and exercise psychology research. Psychology of Sport and Exercise, 4(1), 25-39. https://doi.org/10.1016/S1469-0292(02)00015-8 DOI: https://doi.org/10.1016/S1469-0292(02)00015-8
Smith, S. M., Brown, H., & Cotterill, S. T. (2021). Implementing and Evaluating the Practice Environment Model Using Action Research. International Sport Coaching Journal, 9(1), 100-110. https://doi.org/10.1123/iscj.2020-0117 DOI: https://doi.org/10.1123/iscj.2020-0117
Smith, S. M., Cotterill, S. T., & Brown, H. (2019). A case study of factors influencing performance in the practice environment. Case Studies in Sport and Exercise Psychology, 3(1), 33-40. https://doi.org/10.1123/cssep.2019-0004 DOI: https://doi.org/10.1123/cssep.2019-0004
Smith, S. M., Cotterill, S. T., & Brown, H. (2020a). An interpretative phenomenological analysis of performance influencing factors within the practice environment. Journal of Physical Education and Sport, 20(4), 1646-1657. https://doi.org/10.7752/jpes.2020.04224
Smith, S. M., Cotterill, S. T., & Brown, H. (2020b). An Interpretative Phenomenological Analysis of Coach Perceptions in the Practice Environment. The Sport Psychologist, 34(4), 257-267. https://doi.org/10.1123/tsp.2020-0021 DOI: https://doi.org/10.1123/tsp.2020-0021
Smith, R. E., Cumming, S. P., & Smoll, F. L. (2008). Development and validation of the motivational climate scale for youth sports. Journal of Applied Sport Psychology, 20(1), 116-136. https://doi.org/10.1080/10413200701790558 DOI: https://doi.org/10.1080/10413200701790558
Smith, J. L., Sansone, C., & White, P. H. (2007). The stereotyped task engagement process: The role of interest and achievement motivation. Journal of Educational Psychology, 99(1), 99-114. https://doi.org/10.1037/0022-0663.99.1.99 DOI: https://doi.org/10.1037/0022-0663.99.1.99
Stamenković, D., & Vesković, A. (2022). The association between intensity and direction of competitive anxiety with pre-performance expectations and competition performance. Facta Universitatis. Series: Physical Education and Sport, 175-189.
Tabachnick, B. G. &, Fidell, L. S., (2014). Using multivariate statistics (New international Ed.) Pearson.
Wachsmuth, S., Jowett, S., & Harwood, C. G. (2018). On understanding the nature of interpersonal conflict between coaches and athletes. Journal of Sports Sciences, 36(15), 1-8. https://doi.org/10.1080/02640414.2018.1428882 DOI: https://doi.org/10.1080/02640414.2018.1428882
Wagstaff, C. R. (2019). Taking stock of organizational psychology in sport. Journal of Applied Sport Psychology, 31(1), 1-6. https://doi.org/10.1080/10413200.2018.1539785 DOI: https://doi.org/10.1080/10413200.2018.1539785
Zsido, A. N., Teleki, S. A., Csokasi, K., Rozsa, S., & Bandi, S. A. (2020). Development of the short version of the spielberger state-trait anxiety inventory. Psychiatry Research, 291, 113223. https://doi.org/10.1016/j.psychres.2020.113223 DOI: https://doi.org/10.1016/j.psychres.2020.113223
Zumbo, B. D., Gadermann, A. M., & Zeisser, C. (2007). Ordinal versions of coefficients alpha and theta for Likert rating scales. Journal of Modern Applied Statistical Methods, 6(1), 21-29. https://doi.org/10.22237/jmasm/1177992180 DOI: https://doi.org/10.22237/jmasm/1177992180