Assessment of Self-Determined Motivation in Exercise: A Systematic Review and Meta-analysis

Truong Thanh Nam, Cua Ngoc Le, Doan Hoang Phu, Muhammad Haroon Stanikzai, Shamarina Shohaimi, Omid Dadras, Sang-arun Isaramalai, Charuai Suwanbamrung

Abstract


systematic review and meta-analysis to assess associations between types of self-determined motivation in exercise with selected parameters of studies using Behavioral Regulation in Exercise Questionnaires (BREQs). Following PRISMA 2020 guidelines, we screened 244 studies from PubMed, ScienceDirect, and Scopus against criteria and selected 43 articles for qualitative synthesis. Of those, 40 studies reporting mean scores and standard deviations of six regulations of BREQs, representing self-determined motivation types, were selected for meta-analysis. The pooled mean scores were the highest in intrinsic regulation at 4.00 (95%CI: 2.92–5.09), followed by identified, integrated, introjected, external, and motivation regulations at 3.65 (95%CI: 3.06–4.24), 3.11 (95%CI: 2.68–3.55), 2.21 (95%CI: 1.88–2.53), 1.42 (95%CI: 0.93–1.92), and 0.94 (95%CI: 0.67–1.12), respectively. Findings indicated significant associations between longer exercise duration and introjected (β = 0.014, p = 0.027) and identified (β = 0.014, p = 0.021) regulations. An inverse relationship was found with a higher female participation rate (β=-0.047, p=0.042), while exercise settings in sports and fitness centers exhibited a stronger association with intrinsic motivations (β=2.700, p=0.039). No significant differences were observed among the versions of BREQs in measuring self-determined motivation. This investigation of context invariance utilizing the particular validated scale contributes to furthering comprehension of the instrument in sports and fitness settings. Additionally, it is essential to take into account sex and the exercise environment concerning self-determined motivation when predicting long-term exercise adherence.

 

Doi: 10.28991/HEF-2023-04-02-08

Full Text: PDF


Keywords


Exercise; Self-determined Motivation; BREQ; Systematic Review; Meta-analysis.

References


Ng, J. Y. Y., Ntoumanis, N., Thøgersen-Ntoumani, C., Deci, E. L., Ryan, R. M., Duda, J. L., & Williams, G. C. (2012). Self-Determination Theory Applied to Health Contexts: A Meta-Analysis. Perspectives on Psychological Science, 7(4), 325–340. doi:10.1177/1745691612447309.

Cook, D. A., & Artino, A. R. (2016). Motivation to learn: an overview of contemporary theories. Medical Education, 50(10), 997–1014. doi:10.1111/medu.13074.

Teixeira, P. J., Carraça, E. V., Markland, D., Silva, M. N., & Ryan, R. M. (2012). Exercise, physical activity, and self-determination theory: A systematic review. International Journal of Behavioral Nutrition and Physical Activity, 9, 78. doi:10.1186/1479-5868-9-78.

Mullan, E., Markland, D., & Ingledew, D. K. (1997). A graded Conceptualisation of self-determination in the regulation of exercise behaviour: Development of a measure using confirmatory factor analytic procedures. Personality and Individual Differences, 23(5), 745–752. doi:10.1016/S0191-8869(97)00107-4.

Markland, D., & Tobin, V. (2004). A modification to the behavioural regulation in exercise questionnaire to include an assessment of amotivation. Journal of Sport and Exercise Psychology, 26(2), 191–196. doi:10.1123/jsep.26.2.191.

Wilson, P. M., Rodgers, W. M., Loitz, C. C., & Scime, G. (2007). “It’s Who I Am … Really!’ The Importance of Integrated Regulation in Exercise Contexts1. Journal of Applied Biobehavioral Research, 11(2), 79–104. doi:10.1111/j.1751-9861.2006.tb00021.x.

Ingledew, D. K., Markland, D., & Strömmer, S. T. (2014). Elucidating the roles of motives and gains in exercise participation. Sport, Exercise, and Performance Psychology, 3(2), 116–131. doi:10.1037/spy0000004.

Elsborg, P., Heinze, C., Melby, P. S., Nielsen, G., Bentsen, P., & Ryom, K. (2021). Associations between previous sport and exercise experience and physical literacy elements among physically inactive Danes. BMC Public Health, 21(1), 1248. doi:10.1186/s12889-021-11299-2.

Cavicchiolo, E., Sibilio, M., Lucidi, F., Cozzolino, M., Chirico, A., Girelli, L., Manganelli, S., Giancamilli, F., Galli, F., Diotaiuti, P., Zelli, A., Mallia, L., Palombi, T., Fegatelli, D., Albarello, F., & Alivernini, F. (2022). The Psychometric Properties of the Behavioural Regulation in Exercise Questionnaire (BREQ-3): Factorial Structure, Invariance and Validity in the Italian Context. International Journal of Environmental Research and Public Health, 19(4), 1937. doi:10.3390/ijerph19041937.

Nuss, K., Sui, W., Rhodes, R., & Liu, S. (2023). Motivational Profiles and Associations with Physical Activity Before, During, and After the COVID-19 Pandemic: Retrospective Study. JMIR Formative Research, 7(e43411), 1-10. doi:10.2196/43411.

Nuss, K., & Li, K. (2021). Motivation for physical activity and physcial activity engagement in current and former wearable fitness tracker users: A mixed-methods examination. Computers in Human Behavior, 121, 106798. doi:10.1016/j.chb.2021.106798.

Emm-Collison, L. G., Sebire, S. J., Salway, R., Thompson, J. L., & Jago, R. (2020). Multidimensional motivation for exercise: A latent profile and transition analysis. Psychology of Sport and Exercise, 47, 101619. doi:10.1016/j.psychsport.2019.101619.

Clancy, R. B., Herring, M. P., & Campbell, M. J. (2017). Motivation Measures in Sport: A Critical Review and Bibliometric Analysis. Frontiers in Psychology, 8. doi:10.3389/fpsyg.2017.00348.

Ingledew, D. K., Markland, D., & Sheppard, K. E. (2004). Personality and self-determination of exercise behaviour. Personality and Individual Differences, 36(8), 1921–1932. doi:10.1016/j.paid.2003.08.021.

Ingledew, D. K., & Markland, D. (2008). The role of motives in exercise participation†. Psychology & Health, 23(7), 807–828. doi:10.1080/08870440701405704.

Durán-Vinagre, M. Á., Ibáñez, S. J., Feu, S., & Sánchez-Herrera, S. (2023). Analysis of the motivational processes involved in university physical activity. Frontiers in Psychology, 13(1080162), 1-10. doi:10.3389/fpsyg.2022.1080162.

Sánchez-Herrera, S., Cubero, J., Feu, S., & Durán-Vinagre, M. Á. (2022). Motivation Regarding Physical Exercise among Health Science University Students. International Journal of Environmental Research and Public Health, 19(11), 6524. doi:10.3390/ijerph19116524.

Keadle, S. K., Meuter, L., Phelan, S., & Phillips, S. M. (2021). Charity-based incentives motivate young adult cancer survivors to increase physical activity: a pilot randomized clinical trial. Journal of Behavioral Medicine, 44(5), 682–693. doi:10.1007/s10865-021-00218-w.

Fresno-Alba, S., Leyton-Román, M., Mesquita da Silva, S., & Jiménez-Castuera, R. (2023). Predicting Quality of Life in Women with Breast Cancer Who Engage in Physical Exercise: The Role of Psychological Variables. Healthcare (Switzerland), 11(14), 2088. doi:10.3390/healthcare11142088.

Cid, L., Monteiro, D., Teixeira, D., Teques, P., Alves, S., Moutão, J., Silva, M., & Palmeira, A. (2018). The Behavioral Regulation in Exercise Questionnaire (BREQ-3) Portuguese-version: Evidence of reliability, validity and invariance across gender. Frontiers in Psychology, 9(OCT), 1940. doi:10.3389/fpsyg.2018.01940.

Moustaka, F. C., Vlachopoulos, S. P., Vazou, S., Kaperoni, M., & Markland, D. A. (2010). Initial validity evidence for the Behavioral Regulation in Exercise Questionnaire-2 among Greek exercise participants. European Journal of Psychological Assessment, 26(4), 269–276. doi:10.1027/1015-5759/a000036.

Rodrigues, F., Macedo, R., Teixeira, D., Cid, L., & Monteiro, D. (2020). Motivation in sport and exercise: a comparison between the BRSQ and BREQ. Quality and Quantity, 54(4), 1335–1350. doi:10.1007/s11135-020-00988-6.

Rosa, J. P. P., de Souza, A. A. L., de Lima, G. H. O., Rodrigues, D. F., de Aquino Lemos, V., da Silva Alves, E., Tufik, S., & de Mello, M. T. (2015). Motivational and evolutionary aspects of a physical exercise training program: a longitudinal study. Frontiers in Psychology, 6. doi:10.3389/fpsyg.2015.00648.

Saavedra, J. M., García-Hermoso, A., Escalante, Y., & Domínguez, A. M. (2014). Self-determined motivation, physical exercise and diet in obese children: A three-year follow-up study. International Journal of Clinical and Health Psychology, 14(3), 195–201. doi:10.1016/j.ijchp.2013.12.001.

Prestwich, A., Conner, M., Morris, B., Finlayson, G., Sykes-Muskett, B., & Hurling, R. (2017). Do web-based competitions promote physical activity? Randomized controlled trial. Psychology of Sport and Exercise, 29, 1–9. doi:10.1016/j.psychsport.2016.11.003.

Fuentes-García, J. P., Alonso-Rivas, L., Gómez-Barrado, J. J., Abello-Giraldo, V. M., Jiménez-Castuera, R., & Díaz-Casasola, C. (2021). Modification of the forms of self-determined regulation and quality of life after a cardiac rehabilitation programme: Tennis-based vs. bicycle ergometer-based. International Journal of Environmental Research and Public Health, 18(17), 9207. doi:10.3390/ijerph18179207.

Charles, A., Girard, A., Buckinx, F., Mouton, A., Reginster, J. Y., & Bruyère, O. (2020). Senior physical activity contests in nursing homes: a feasibility study. Aging Clinical and Experimental Research, 32(5), 869–876. doi:10.1007/s40520-020-01529-9.

Liu, J. D., Chung, P. K., Zhang, C. Q., & Si, G. (2015). Chinese-translated Behavioral Regulation in Exercise Questionnaire-2: Evidence from university students in the Mainland and Hong Kong of China. Journal of Sport and Health Science, 4(3), 228–234. doi:10.1016/j.jshs.2014.03.017.

McLachlan, S., Spray, C., & Hagger, M. S. (2011). The development of a scale measuring integrated regulation in exercise. British Journal of Health Psychology, 16(4), 722–743. doi:10.1348/2044-8287.002009.

Zhou, X., & Krishnan, A. (2019). What Predicts Exercise Maintenance and Well-Being? Examining the Influence of Health-Related Psychographic Factors and Social Media Communication. Health Communication, 34(6), 589–597. doi:10.1080/10410236.2018.1428851.

Matsumoto, H., & Takenaka, K. (2004). Motivational Profiles and Stages of Exercise Behavior Change. International Journal of Sport and Health Science, 2, 89–96. doi:10.5432/ijshs.2.89.

Wininger, S. R. (2007). Self-determination theory and exercise behavior: An examination of the psychometric properties of the exercise motivation scale. Journal of Applied Sport Psychology, 19(4), 471–486. doi:10.1080/10413200701601466.

Rhodes, R. E., Martin, A. D., & Taunton, J. E. (2001). Temporal Relationships of Self-Efficacy and Social Support as Predictors of Adherence in a 6-Month Strength-Training Program for Older Women. Perceptual and Motor Skills, 93(3), 693–703. doi:10.2466/pms.2001.93.3.693.

Howley, E. T. (2001). Type of activity: Resistance, aerobic and leisure versus occupational physical activity. Medicine and Science in Sports and Exercise, 33(6 SUPPL.), 364–369. doi:10.1097/00005768-200106001-00005.

Owen, K. B., Smith, J., Lubans, D. R., Ng, J. Y. Y., & Lonsdale, C. (2014). Self-determined motivation and physical activity in children and adolescents: A systematic review and meta-analysis. Preventive Medicine, 67, 270–279. doi:10.1016/j.ypmed.2014.07.033.

Manninen, M., Dishman, R., Hwang, Y., Magrum, E., Deng, Y., & Yli-Piipari, S. (2022). Self-determination theory based instructional interventions and motivational regulations in organized physical activity: A systematic review and multivariate meta-analysis. Psychology of Sport and Exercise, 62, 102248. doi:10.1016/j.psychsport.2022.102248.

Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ, n71. doi:10.1136/bmj.n71.

CASP (2023). Checklists-Critical appraisal skills. Critical Appraisal Skills Programme, Oxford, United Kingdom. Available online: https://casp-uk.net/casp-tools-checklists/ (accessed on May 2023).

Benzing, V., Nosrat, S., Aghababa, A., Barkoukis, V., Bondarev, D., Chang, Y. K., Cheval, B., Çiftçi, M. C., Elsangedy, H. M., Guinto, M. L. M., Huang, Z., Kopp, M., Kristjánsdóttir, H., Kuan, G., Mallia, L., Rafnsson, D., Oliveira, G. T. A., Pesola, A. J., Pesce, C., … Brand, R. (2021). Staying active under restrictions: Changes in type of physical exercise during the initial COVID-19 lockdown. International Journal of Environmental Research and Public Health, 18(22), 12015. doi:10.3390/ijerph182212015.

Harrer, M., Cuijpers, P., Furukawa, T., & Ebert, D. (2021). Doing meta-analysis with R: A hands-on guide. Chapman and Hall/CRC, New York, United States. doi:10.1201/9781003107347.

Lin, L., & Xu, C. (2020). Arcsine-based transformations for meta-analysis of proportions: Pros, cons, and alternatives. Health Science Reports, 3(3), 07 27. doi:10.1002/hsr2.178.

Phu, D. H., Wongtawan, T., Truong, D. B., Van Cuong, N., Carrique-Mas, J., & Thomrongsuwannakij, T. (2022). A systematic review and meta-analysis of integrated studies on antimicrobial resistance in Vietnam, with a focus on Enterobacteriaceae, from a One Health perspective. One Health, 15, 100465. doi:10.1016/j.onehlt.2022.100465.

Teixeira, D. S., Rodrigues, F., Monteiro, D., & Cid, L. (2022). The Behavioral Regulation in Exercise Questionnaire (BREQ-4): Psychometric evidence of introjected approach regulation in Portuguese health club exercisers. Psychology of Sport and Exercise, 63, 102286. doi:10.1016/j.psychsport.2022.102286.

Teixeira, P., & Hagger, M. (2016). Motivation and behaviour change techniques based on self-determination theory: a consensus analysis. European Health Psychologist, 389-389.

Hoang, C. K., Pham, D. T. T., Do, T., Pham, T. T., Nguyen, M. N. T., Vu, Q. C., ... & Nguyen, T. C. (2022). Exploiting Idioms and Proverbs of Vietnamese Regions in Teaching Mathematics in Primary Schools. Emerging Science Journal, 6, 209-224. doi:10.28991/ESJ-2022-SIED-015.

Vlachopoulos, S. P. (2012). Measurement equivalence of the behavioral regulation in exercise questionnaire-2 across Greek men and women exercise participants. Hellenic Journal of Psychology, 9(1), 1-17.

Markland, D., & Tobin, V. J. (2010). Need support and behavioural regulations for exercise among exercise referral scheme clients: The mediating role of psychological need satisfaction. Psychology of Sport and Exercise, 11(2), 91–99. doi:10.1016/j.psychsport.2009.07.001.

Crăciun, M. T., & Rus, C. L. (2012). Factorial validity and reliability evidence for the modified Behavioral Regulation in Exercise Questionnaire – 2 among Romanian adolescents. Procedia - Social and Behavioral Sciences, 33, 528–532. doi:10.1016/j.sbspro.2012.01.177.

Casali, N., Cerea, S., Moro, T., Paoli, A., & Ghisi, M. (2021). Just Do It: High Intensity Physical Activity Preserves Mental and Physical Health in Elite and Non-elite Athletes During COVID-19. Frontiers in Psychology, 12, 757150. doi:10.3389/fpsyg.2021.757150.

Hutmacher, D., Eckelt, M., Bund, A., & Steffgen, G. (2021). Lifting the Curtain on Motivation in Exercise: Validation of Two Questionnaires for Physical Education and Leisure Time in French and German. Journal of Psychoeducational Assessment, 39(5), 623–639. doi:10.1177/07342829211005571.

Murcia, J., Gimeno, E. C., & Camacho, A. M. (2007). Measuring self-determination motivation in a physical fitness setting: validation of the Behavioural Regulation in Exercise Questionnaire-2 (BREQ-2) in a Spanish sample. The Journal of Sport Medicine and Physical Fitness, 47(3), 366-378.

León-Guereño, P., Tapia-Serrano, M. A., & Sánchez-Miguel, P. A. (2020). The relationship of recreational runners’ motivation and resilience levels to the incidence of injury: A mediation model. PLoS ONE, 15(5), 1-11. doi:10.1371/journal.pone.0231628.

Cid, L., Moutão, J., Leitão, J., & Alves, J. (2012). Behavioral Regulation Assessment in Exercise: Exploring an Autonomous and Controlled Motivation Index. The Spanish Journal of Psychology, 15(3), 1520–1528. doi:10.5209/rev_sjop.2012.v15.n3.39436.

Blom, V., Drake, E., Kallings, L. V., Ekblom, M. M., & Nooijen, C. F. (2021). The effects on self-efficacy, motivation and perceived barriers of an intervention targeting physical activity and sedentary behaviours in office workers: a cluster randomized control trial. BMC public health, 21(1), 1-9. doi:10.1186/s12889-021-11083-2.

Markland, D., & Ingledew, D. K. (2007). The relationships between body mass and body image and relative autonomy for exercise among adolescent males and females. Psychology of Sport and Exercise, 8(5), 836–853. doi:10.1016/j.psychsport.2006.11.002.

Tornero-Quiñones, I., Sáez-Padilla, J., Viera, E. C., Ferrete, J. J. G., & Robles, Á. S. (2019). Risk of dependence on sport in relation to body dissatisfaction and motivation. Sustainability (Switzerland), 11(19), 5299. doi:10.3390/su11195299.

Naziroğlu, M., Demiral, Ş., & Özbar, N. (2023). Investigation of Motivation Levels of National Team Athletes Competing During the COVID-19 Pandemic Crisis (Judo, Wrestling and Taekwondo Example): Descriptive Research. Turkiye Klinikleri Journal of Sports Sciences, 15(2), 258–263. doi:10.5336/sportsci.2023-96086.

Farholm, A., & Sørensen, M. (2016). Motivation for physical activity and exercise in severe mental illness: A systematic review of cross‐sectional studies. International Journal of Mental Health Nursing, 25(2), 116-126. doi:10.1111/inm.12217.

Ersöz, G., Elmas, A. G., & Aşçi, F. H. (2021). Psychometric properties of Turkish version of the Behavioural Regulation in Exercise Questionnaire (BREQ-3). International Journal of Sport Psychology, 52(6), 527–542. doi:10.7352/IJSP.2021.52.527.

Duncan, L. R., Hall, C. R., Wilson, P. M., & Jenny, O. (2010). Exercise motivation: A cross-sectional analysis examining its relationships with frequency, intensity, and duration of exercise. International Journal of Behavioral Nutrition and Physical Activity, 7(1), 7. doi:10.1186/1479-5868-7-7.

Miquelon, P., & Castonguay, A. (2016). Motives for Participation in Physical Activity and Observance of Physical Activity Recommendations among Adults with Type 2 Diabetes. Canadian Journal of Diabetes, 40(5), 399–405. doi:10.1016/j.jcjd.2016.02.009.

Borges, J. C., de Oliveira Filho, G. G., de Lira, C. A. B., da Silva, R. A. D., Alves, E. da S., Benvenutti, M. J., & Rosa, J. P. P. (2021). Motivation Levels and Goals for the Practice of Physical Exercise in Five Different Modalities: A Correspondence Analysis. Frontiers in Psychology, 12(793238). doi:10.3389/fpsyg.2021.793238.

Box, A. G., Feito, Y., Brown, C., & Petruzzello, S. J. (2019). Individual differences influence exercise behavior: how personality, motivation, and behavioral regulation vary among exercise mode preferences. Heliyon, 5(4). doi:10.1016/j.heliyon.2019.e01459.

Samendinger, S., & Hill, C. R. (2021). Exercise schema and motivational regulation of college students: A person-centered analysis. Psychology of Sport and Exercise, 54, 101921. doi:10.1016/j.psychsport.2021.101921.

Liu, L., Xiang, M., Guo, H., Sun, Z., Wu, T., & Liu, H. (2020). Reliability and Validity of the Behavioral Regulation in Exercise Questionnaire-2 for Nursing Home Residents in China. Asian Nursing Research, 14(1), 11–16. doi:10.1016/j.anr.2019.12.002.

Chu, I. H., Chen, Y. L., Wu, P. T., Wu, W. L., & Guo, L. Y. (2021). The associations between self-determined motivation, multidimensional self-efficacy, and device-measured physical activity. International Journal of Environmental Research and Public Health, 18(15). doi:10.3390/ijerph18158002.

Gorny, A. W., Low, M. C., Sayampanathan, A. A., Shiraz, F., & Müller-Riemenschneider, F. (2021). Motivations to exercise in young men following a residential weight loss programme conducted in National Service - a mixed methods study. BMC Public Health, 21(1). doi:10.1186/s12889-021-10373-z.

Jenkins, M., Wilson, O. W., Richards, J., Huthwaite, M., Skirrow, P., Grant, E., & Every-Palmer, S. (2023). The association between motivation and physical activity among forensic and rehabilitation inpatients in Aotearoa New Zealand. The Journal of Sport and Exercise Science, 7(2), 9–17. doi:10.36905/jses.2023.02.02.

Craike, M. J., Polman, R., Eime, R., Symons, C., Harvey, J., & Payne, W. (2014). Associations between behavior regulation, competence, physical activity, and health for adolescent females. Journal of Physical Activity and Health, 11(2), 410–418. doi:10.1123/jpah.2012-0070.

Moreno-Murcia, J. A., Gimeno, E. C., Hernández, E. H., Belan-do Pedreño, N., & Marín, J. J. R. (2013). Motivational profiles in physical education and their relation to the Theory of Planned Behavior. Journal of sports science & medicine, 12(3), 551.

Riseth, L., Nøst, T. H., Nilsen, T. I. L., & Steinsbekk, A. (2019). Long-term members’ use of fitness centers: A qualitative study. BMC Sports Science, Medicine and Rehabilitation, 11(1), 9. doi:10.1186/s13102-019-0114-z.

Sperandei, S., Vieira, M. C., & Reis, A. C. (2016). Adherence to physical activity in an unsupervised setting: Explanatory variables for high attrition rates among fitness center members. Journal of Science and Medicine in Sport, 19(11), 916–920. doi:10.1016/j.jsams.2015.12.522.

Mullen, S. P., & Whaley, D. E. (2010). Age, gender, and fitness club membership: Factors related to initial involvement and sustained participation. International Journal of Sport and Exercise Psychology, 8(1), 24–35. doi:10.1080/1612197X.2010.9671931.

Gjestvang, C., Abrahamsen, F., Stensrud, T., & Haakstad, L. A. H. (2020). Motives and barriers to initiation and sustained exercise adherence in a fitness club setting—A one-year follow-up study. Scandinavian Journal of Medicine and Science in Sports, 30(9), 1796–1805. doi:10.1111/sms.13736.

Gardner, L. A., Magee, C. A., & Vella, S. A. (2017). Enjoyment and behavioral intention predict organized youth sport participation and dropout. Journal of Physical Activity and Health, 14(11), 861–865. doi:10.1123/jpah.2016-0572.

Teixeira, D. S., Pelletier, L. G., Monteiro, D., Rodrigues, F., Moutão, J., Marinho, D. A., & Cid, L. (2020). Motivational patterns in persistent swimmers: A serial mediation analysis. European Journal of Sport Science, 20(5), 660–669. doi:10.1080/17461391.2019.1675768.

Moreno-Murcia, J. A., Belando, N., Huéscar, E., & Torres, M. D. (2017). Social support, physical exercise and life satisfaction in women. Revista Latinoamericana de Psicología, 49(3), 194–202. doi:10.1016/j.rlp.2016.08.002.


Full Text: PDF

DOI: 10.28991/HEF-2023-04-02-08

Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Nam Thanh Truong, Cua Ngoc Le, Doan Hoang Phu, Muhammad Haroon Stanikzai, Shamarina Shohaimi, Omid Dadras, Sang-arun Isaramalai, Charuai Suwanbamrung