An Effect of Assessment Delivery Methods on Accounting Students’ Grades in an E-learning Environment

Fahd Haidar

doi:10.24310/ijtei.101.2024.17672

Authors

Fahd Haidar Majmaah University, Saudi Arabia https://orcid.org/0000-0003-0969-9738

DOI:

https://doi.org/10.24310/ijtei.101.2024.17672

Keywords:

Online assessment method, Hybrid assessment method, Assessment methods, Accounting student’s grade, E-learning environment

Abstract

The study aims to investigate whether a change in the delivery of assessment methods, from a full online assessment to a hybrid assessment, affected accounting students' grades during the COVID-19 Pandemic. This study also considers whether the change undertaken to assessment methods met their targets of improving assessment practices and maintaining academic integrity. The statistical analysis technique used was an independent sample t-test, chi-square, and ANOVA. A total of 473 final grades (fully online assessment = 224, hybrid assessment = 249) were collected to achieve the study purpose. The findings show a statistically significant difference in the final course grades between the two assessment methods. In each course, students scored significantly lower on the hybrid assessment compared to students who took the fully online assessment, indicating that changes in the assessment delivery method affected students' grades and that the shift to hybrid assessment had a positive effect assessment system. Additionally, the performance of males and females is too different; female students have made higher grades than peer males in both methods in each course, indicating that the grades between males and females are different. This research recommends that the use of a hybrid assessment approach would help in providing a unique educational environment and this approach of varied assessment can enable lecturers to find out student abilities in accounting courses and maintain academic integrity.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Author Biography

Fahd Haidar, Majmaah University,

Majmaah University

References

Aisbitt, S., & Sangster, A. (2005). Using internet-based on-line assessment: A case study. Accounting Education, 14(4), 383–394. https://doi.org/10.1080/06939280500346011

Al-Maqbali, A. H., & Al-Shamsi, A. (2023). Assessment Strategies in Online Learning Environments During the COVID-19 Pandemic in Oman. Journal of University Teaching & Learning Practice, 20(5), 1–21. https://doi.org/10.53761/1.20.5.08

Almossa, S. Y. (2021). University students’ perspectives toward learning and assessment during COVID-19. Education and Information Technologies, 26(6), 7163–7181. https://doi.org/10.1007/s10639-021-10554-8

Almossa, S.Y., & Alzahrani, S.M. (2022). Assessment practices in Saudi higher education during the COVID-19 pandemic. Humanities and Social Sciences Communications, 9(5), 1-9. https://doi.org/10.1057/s41599-021-01025-z

Astleitner, H., & Steinberg, R. (2005). Are there gender differences in web-based learning? An integrated model and related effect sizes. AACE Journal, 13(1), 47–63.

Bautista Flores, E., Quintana, N. L., & Sánchez Carlos, O. A. (2022). Distance education with university students quarantined by COVID-19. Innoeduca. International Journal of Technology and Educational Innovation, 8(2), 5–13. https://doi.org/10.24310/innoeduca.2022.v8i2.12257

Bilen, E., & Matros, A. (2021). Online cheating amid COVID-19. Journal of Economic Behavior and Organization, 182, 196–211. https://doi.org/10.1016/j.jebo.2020.12.004

Brallier, A. S., Schwanz, A. K., Palm, J. L., & Irwin, N. L. (2015). Online Testing: Comparison of Online and Classroom Exams in an Upper-Level Psychology Course. American Journal of Educational Research, 3(2), 255-258. https://doi.org/10.12691/education-3-2-20

Bunn, E., Fischer, M., & Marsh, T. (2014). Does the Classroom Delivery Method Make a Difference? American Journal of Business Education, 7(2), 143–150.

Cater, J. J., Michel, N., & Varela, O. E. (2012). Challenges of Online Learning in Management Education: An Empirical Study. Journal of Applied Management & Entrepreneurship, 17(4), 76–96.

Chen, I. Y. L., Yang, A. C. M., Flanagan, B., & Ogata, H. (2022). How students’ self-assessment behavior affects their online learning performance. Computers and Education: Artificial Intelligence, 3, e100058. https://doi.org/10.1016/j.caeai.2022.100058

Cohen, J. (1992). Statistical Power Analysis. Current Directions in Psychological Science, 1(3), 98-101. https://doi.org/10.1111/1467-8721.ep10768783

Cuadrado-García, M., Ruiz-Molina, M.-E., & Montoro-Pons, J. D. (2010). Are there gender differences in e-learning use and assessment? Evidence from an interuniversity online project in Europe. Procedia - Social and Behavioral Sciences, 2(2), 367–371. https://doi.org/10.1016/j.sbspro.2010.03.027

Da Silva, D. M., Leal, E. A., Pereira, J. M., & de Oliveira Neto, J. D. (2015). Learning styles and academic performance in Distance Education: a research in specialization courses. RBGN-REVISTA BRASILEIRA DE GESTAO DE NEGOCIOS, 17(57), 1300–1316. https://doi.org/10.7819/rbgn.v17i57.1852

Duncan, K., Kenworthy, A., & McNamara, R. (2012). The Effect of Synchronous and Asynchronous Participation on Students’ Performance in Online Accounting Courses. Accounting Education, 21(4), 431–449. https://doi.org/10.1080/09639284.2012.673387

Eltahir, M. E., Alsalhi, N. R., & Al-Qatawneh, S. S. (2022). Implementation of E-exams during the COVID-19 pandemic: A quantitative study in higher education. PLoS ONE, 17(5), 1–20. https://doi.org/10.1371/journal.pone.0266940

Eurboonyanun, C., Wittayapairoch, J., Aphinives, P., Petrusa, E., Gee, D. W., & Phitayakorn, R. (2020). Adaptation to Open-Book Online Examination During the COVID-19 Pandemic. Journal of Surgical Education, 78(3), 737–739. https://doi.org/10.1016/j.jsurg.2020.08.046

Gamage, K. A. A., Silva, E. K. de, & Gunawardhana, N. (2020). Online Delivery and Assessment during COVID-19: Safeguarding Academic Integrity. Education Sciences, 10(11), e301. https://doi.org/10.3390/educsci10110301

Glazier, R. A., Hamann, K., Pollock, P. H., & Wilson, B. M. (2020). Age, Gender, and Student Success: Mixing Face-to-Face and Online Courses in Political Science. Journal of Political Science Education, 16(2), 142–157. https://doi.org/10.1080/15512169.2018.1515636

Gomaa, M., Fei Kang, & Hong Pak. (2021). Student Performance in Online Accounting Tests: In-class vs. Take-home. Pan-Pacific Journal of Business Research, 12(1), 49–60.

Guangul, F. M., Suhail, A. H., Khalit, M. I., & Khidhir, B. A. (2020). Challenges of remote assessment in higher education in the context of COVID-19: a case study of Middle East College. Educational Assessment, Evaluation and Accountability: International Journal of Policy, Practice and Research, 32(4), 519. https://doi.org/10.1007/s11092-020-09340-w

Hafeez, M., Ajmal, F., & Zulfiqar, Z. (2022). Assessment of Students’ Academic Achievements in Online and Face-to-Face Learning in Higher Education. Journal of Technology and Science Education, 12(1), 259–273. https://doi.org/10.3926/jotse.1326

Haidar, F. T. (2022). Accounting Students' Perceptions on A Role of Distance Education in Their Soft Skills Development. Journal of Organizational Behavior Research, 7(2), 188-202. https://doi.org/10.51847/8dK1WcPfHd

Harvey, H. L., Parahoo, S., & Santally, M. (2017). Should Gender Differences be Considered When Assessing Student Satisfaction in the Online Learning Environment for Millennials? Higher Education Quarterly, 71(2), 141–158. https://doi.org/10.1111/hequ.12116

Helfaya, A. (2019). Assessing the use of computer-based assessment-feedback in teaching digital accountants. Accounting Education, 28(1), 69–99. https://doi.org/10.1080/09639284.2018.1501716

Hew, K. F., Jia, C., Gonda, D. E., & Bai, S. (2020). Transitioning to the “new normal” of learning in unpredictable times: pedagogical practices and learning performance in fully online flipped classrooms. International Journal of Educational Technology in Higher Education, 17(1). https://doi.org/10.1186/s41239-020-00234-x

Hewson, C. (2012). Can online course-based assessment methods be fair and equitable? Relationships between students’ preferences and performance within online and offline assessments. Journal of Computer Assisted Learning, 28(5), 488-498–498. https://doi.org/10.1111/j.1365-2729.2011.00473.x

Hsiao, Y. C. (2021). Impacts of course type and student gender on distance learning performance: A case study in Taiwan. Education and Information Technologies, 26, 6807–6822. https://doi.org/10.1007/s10639-021-10538-8

Idrizi, E., Filiposka, S., & Trajkovik, V. (2021). Analysis of Success Indicators in Online Learning. International Review of Research in Open and Distributed Learning, 22(2), 205–223. https://doi.org/10.19173/irrodl.v22i2.5243

James, S., Swan, K., & Daston, C. (2016). Retention, Progression and the Taking of Online Courses. Online Learning, 20(2), 75–96. https://doi.org/10.24059/olj.v20i2.780

Jimaa, S. (2011). The impact of assessment on students learning. Procedia - Social and Behavioral Sciences, 28, 718–721. https://doi.org/10.1016/j.sbspro.2011.11.133

Ladyshewsky, R. K. (2015). Post-graduate student performance in ‘supervised in-class’ vs. ‘unsupervised online’ multiple choice tests: implications for cheating and test security. Assessment and Evaluation in Higher Education, 40(7), 883-897–897. https://doi.org/10.1080/02602938.2014.956683

Marriott, P. (2009). Students’ Evaluation of the Use of Online Summative Assessment on an Undergraduate Financial Accounting Module. British Journal of Educational Technology, 40(2), 237–254.https://doi.org/10.1111/j.1467-8535.2008.00924.x

Moore, J. L., Dickson-Deane, C., & Galyen, K. (2011). e-Learning, online learning, and distance learning environments: Are they the same? The Internet and Higher Education, 14(2), 129–135. https://doi.org/10.1016/j.iheduc.2010.10.001

Newton, D. (2020). ‘Another problem with shifting education online: A rise in cheating’, Washington post, https://www.washingtonpost.com/local/education/another-problem-with-shifting-education-online-a-rise-in-cheating/2020/08/07/1284c9f6-d762-11ea-aff6-220dd3a14741_story.html

Noroozi, O., Hatami, J., Bayat, A., van Ginkel, S., Biemans, H. J. A., & Mulder, M. (2020). Students’ Online Argumentative Peer Feedback, Essay Writing, and Content Learning: Does Gender Matter? Interactive Learning Environments, 28(6), 698–712. https://doi.org/10.1080/10494820.2018.1543200

Oguguo, B., Ezechukwu, R., Nannim, F., & Offor, K. (2023). Analysis of teachers in the use of digital resources in online teaching and assessment in COVID times . Innoeduca. International Journal of Technology and Educational Innovation, 9(1), 81–96. https://doi.org/10.24310/innoeduca.2023.v9i1.15419

Pasion, R., Dias-Oliveira, E., Camacho, A., Morais, C., & Campos Franco, R. (2021). Impact of COVID-19 on undergraduate business students: a longitudinal study on academic motivation, engagement and attachment to university. Accounting Research Journal, 34(2), 246–257. https://doi.org/10.1108/ARJ-09-2020-0286

Paz Saavedra, L. E., Gisbert Cervera, M., & Usart Rodríguez, M. (2022). Teaching digital competence, attitude and use of digital technologies by university professors. Pixel-Bit. Revista de Medios y Educación, (63), 93–130. https://doi.org/10.12795/pixelbit.91652

Perera, L., & Richardson, P. (2010). Students’ Use of Online Academic Resources within a Course Web Site and Its Relationship with Their Course Performance: An Exploratory Study. Accounting Education, 19(6), 587–600. https://doi.org/10.1080/09639284.2010.529639

Pierce, R. J. (2011). Web-based Assessment Settings and Student Achievement. Journal of Applied Learning Technology, 1(4), 28–31.

Rogerson-Revell, P. (2015). Constructively aligning technologies with learning and assessment in a distance education master’s programme. Distance Education, 36(1), 129–147. https://doi.org/10.1080/01587919.2015.1019972

Rovai, A. P. (2000). Online and traditional assessments: what is the difference? The Internet and Higher Education, 3(3), 141–151. https://doi.org/10.1016/S1096-7516(01)00028-8

Schinske, J., & Tanner, K. (2014). Teaching More by Grading Less (or Differently). CBE Life Sciences Education, 13(2), 159-166. https://doi.org/10.1187/cbe.CBE-14-03-0054

Sharadgah, T. A., & Sa’di, R. A. (2020). Preparedness of Institutions of Higher Education for Assessment in Virtual Learning Environments during the COVID-19 Lockdown: Evidence of Bona Fide Challenges and Pragmatic Solutions. Journal of Information Technology Education: Research, 19, 755–774. https://doi.org/10.28945/4615

Soffer, T., & Nachmias, R. (2018). Effectiveness of Learning in Online Academic Courses Compared with Face-to-Face Courses in Higher Education. Journal of Computer Assisted Learning, 34(5), 534–543. https://doi.org/10.1111/jcal.12258

Thathsarani, H., Ariyananda, D. K., Jayakody, C., Manoharan, K., Munasinghe, A. A. S. N., & Rathnayake, N. (2023). How successful the online assessment techniques in distance learning have been, in contributing to academic achievements of management undergraduates? Education and Information Technologies, 28, 14091–14115. https://doi.org/10.1007/s10639-023-11715-7

Tucker, S. Y. (2000, 24-28 april). Assessing the Effectiveness of Distance Education versus Traditional On-Campus Education. Annual Meeting of the American Educational Research Association. New Orleans, EE.UU.

Verbree, A.-R., Hornstra, L., Maas, L., & Wijngaards-de Meij, L. (2023). Conscientiousness as a Predictor of the Gender Gap in Academic Achievement. Research in Higher Education, 64(3), 451–472. https://doi.org/10.1007/s11162-022-09716-5

Voyer, D., & Voyer, S. D. (2014). Gender Differences in Scholastic Achievement: A Meta-Analysis. Psychological Bulletin, 140(4), 1174–1204. https://doi.org/10.1037/a0036620

Ward, E. J., & Lindshield, B. L. (2020). Performance, behaviour and perceptions of an open educational resource-derived interactive educational resource by online and campus university students. Research in Learning Technology, 28. https://doi.org/10.25304/rlt.v28.2386

White, A. (2021). May you live in interesting times: a reflection on academic integrity and accounting assessment during COVID19 and online learning? Accounting Research Journal, 34(3), 304–312. https://doi.org/10.1108/ARJ-09-2020-0317

Workman, J., & Heyder, A. (2020). Gender achievement gaps: the role of social costs to trying hard in high school. Social Psychology of Education, 23, 1407–1427. https://doi.org/10.1007/s11218-020-09588-6

Yates, R. W., & Beaudrie, B. (2009). The Impact of Online Assessment on Grades in Community College Distance Education Mathematics Courses. American Journal of Distance Education, 23(2), 62–70. https://doi.org/10.1080/08923640902850601