Demotivating Online Formative Assessment Strategies at an Open Distance Learning University

Antonia Makina

doi:10.25159/2663-5895/13117

Authors

Antonia Makina University of South Africa https://orcid.org/0000-0002-2602-0347

DOI:

https://doi.org/10.25159/2663-5895/13117

Keywords:

demotivating online formative assessment strategies, online learning, open and distance learning (ODL), motivation, persistence

Abstract

Online formative assessment strategies are an important element in the level of engagement needed for motivating students learning online in open distance learning (ODL) because they are key in offering large-scale interactive participation. While many studies have looked at the advantages of online formative assessment strategies, they have neglected demotivating online formative assessment strategies that students struggle with. To ensure the quality of the online assessment, it is also important to understand the nature of assessment practices that demotivate students from persisting with their studies. This is because the type of online assessment that students struggle with should guide the choice and design of the online formative assessment strategies. Therefore, this article identifies online formative assessment strategies that demotivate students from participating persistently in online formative assessment in ODL in order to improve the design and development of online learning. This study used a developmental research approach to carry out a descriptive quantitative case study survey involving 112 purposefully sampled students, of which 58 responded, who were registered for a master’s in education in ODL course at an ODL university in South Africa. A thematic coding process was adopted during the analysis of students’ responses to an online Google form. Though students differed in their choices of the online formative assessment strategies that demotivated them in their studies, there was consensus on seven significant themes. The socio-technological perspective and the self-determination theory were used as the theoretical frameworks to drive the investigation since they encompassed all relevant aspects of the design of online learning and motivation to learn online. Information regarding demotivating online formative assessment strategies provide insight to course leaders and instructional designers attempting to build successful online learning strategies that motivate students to participate persistently in online learning environments.

References

Acquaro, P. 2020. “Structuring and Scaffolding the Online Course.” International Journal of Online Graduate Education 3 (1): 1–16.

Ahmed, N., B. Kloot, and B. I. Collier-Reed. 2015. “Why Students Leave Engineering and Built Environment Programmes When They Are Academically Eligible to Continue.” European Journal of Engineering Education 40 (2): 128–44. https://doi.org/10.1080/03043797.2014.928670. DOI: https://doi.org/10.1080/03043797.2014.928670

Bates, A., and A. Sangrà. 2011. Managing Technology in Higher Education: Strategies for Transforming Teaching and Learning. San Francisco, CA: Jossey–Bass/John Wiley and Co.

Bates, T. 2012. “What’s Right and What’s Wrong with Coursera-Style MOOCs.” Online Learning and Distance Education Resources (blog), August 5, 2012. Accessed October 3, 2023. https://www.tonybates.ca/2012/08/05/whats-right-and-whats-wrong-about-coursera-style-moocs/.

Baxter, G., and I. Sommerville. 2011. “Socio-Technical Systems: From Design Methods to Systems Engineering.” Interacting with Computers 23 (1): 4–17. https://doi.org/10.1016/j.intcom.2010.07.003. DOI: https://doi.org/10.1016/j.intcom.2010.07.003

Bekele, T. A. 2010. “Motivation and Satisfaction in Internet-Supported Learning Environments: A Review.” Educational Technology and Society 13 (2): 116–27.

Boud, D. 2018. “Assessment Could Demonstrate Learning Gains, But What Is Required for It to Do So?” Higher Education Pedagogies 3 (1): 54–56. https://doi.org/10.1080/23752696.2017.1413671. DOI: https://doi.org/10.1080/23752696.2017.1413671

Brandl, K. 2002. “Students’ Attitudes and Perceptions of Learning: A Comparative Study of a Classroom-Based and Web-Based Language Course. Taking Language Instruction Online: Progress or Demise?” Paper presented at CALICO 2002, Revolutionizing Language Instruction, University of California, Davis, CA.

Brophy, J. 2010. Motivating Students to Learn. 3rd ed. New York, NY: Routledge. https://doi.org/10.1016/B978-0-08-044894-7.00613-8. DOI: https://doi.org/10.1016/B978-0-08-044894-7.00613-8

Carrillo-de-la-Peña, M. T., E. Baillès, X. Caseras, À. Martínez, G. Ortet, and J. Pérez. 2009. “Formative Assessment and Academic Achievement in Pre-Graduate Students of Health Sciences.” Advances in Health Sciences Education 14 (1): 61–67. https://doi.org/10.1007/s10459-007-9086-y. DOI: https://doi.org/10.1007/s10459-007-9086-y

Cavanagh, R., B. Waldrip, J. Romanoski, D. Fisher, and J. Dorman. 2005. “Measuring Student Perceptions of Classroom Assessment.” Paper presented at the Australian Association for Research in Education (AARE) Annual Conference, Parramatta, New South Wales, Australia.

Chamberlin, J. L. 2010. “The Cultural Reproduction of Architecture: Examining the Roles of Cultural Capital and Organizational Habitus in the Socialization of Architectural Education.” PhD diss., University of Michigan. https://deepblue.lib.umich.edu/bitstream/handle/2027.42/78907/jcham_1.pdf?sequence=1.

CHE (Council on Higher Education). 2014. Distance Higher Education Programmes in a Digital Era: Good Practice Guide. Pretoria: CHE. Accessed October 3, 2023. https://www.saide.org.za/documents/CHE_-_Distance_Higher_Education.pdf.

Cowie, B., and J. Moreland. 2015. “Leveraging Disciplinary Practices to Support Students’ Active Participation in Formative Assessment.” Assessment in Education: Principles, Policy and Practice 22 (2): 247–64. https://doi.org/10.1080/0969594X.2015.1015960. DOI: https://doi.org/10.1080/0969594X.2015.1015960

Deci, E. L., R. Koestner, and R. M. Ryan. 2001. “Extrinsic Rewards and Intrinsic Motivation in Education: Reconsidered Once Again.” Review of Educational Research 71 (1): 1–27. https://doi.org/10.3102/00346543071001001. DOI: https://doi.org/10.3102/00346543071001001

Deci, E. L., and R. M. Ryan. 2012. “Motivation, Personality, and Development within Embedded Social Contexts: An Overview of Self-Determination Theory.” In The Oxford Handbook of Human Motivation, edited by R. M. Ryan, 85–108. Oxford: Oxford Academic. https://doi.org/10.1093/oxfordhb/9780195399820.013.0006. DOI: https://doi.org/10.1093/oxfordhb/9780195399820.013.0006

Elezi, E., and C. Bamber. 2017. “Enhancing Students Learning Experience via In-Class Formative Assessments: A Business Studies UK Higher Education Example.” British Journal of Education 5 (9): 69–88.

Filsecker, M., and M. Kerres. 2012. “Repositioning Formative Assessment from an Educational Assessment Perspective: A Response to Dunn and Mulvenon (2009).” PARE: Practical Assessment, Research and Evaluation 17 (16). https://scholarworks.umass.edu/cgi/viewcontent.cgi?article=1285&context=pare.

Fisher, D. L., B. G. Waldrip, and J. Dorman. 2005. “Student Perceptions of Assessment: Development and Validation of a Questionnaire.” Paper presented at the Annual Meeting of the American Educational Research Association, Montreal, Canada.

Gikandi, J. W., D. Morrow, and N. E. Davis. 2011. “Online Formative Assessment in Higher Education: A Review of the Literature.” Computers and Education 57 (4): 2333–351. https://doi.org/10.1016/j.compedu.2011.06.004. DOI: https://doi.org/10.1016/j.compedu.2011.06.004

Gordon, N. 2014. Flexible Pedagogies: Technology-Enhanced Learning. York: The Higher Education Academy (HEA).

Haugan, J., M. Lysebo, and P. Lauvas. 2017. “Mandatory Coursework Assignments Can Be, and Should Be, Eliminated!” European Journal of Engineering Education 42 (6): 1408–421. https://doi.org/10.1080/03043797.2017.1301383. DOI: https://doi.org/10.1080/03043797.2017.1301383

Havnes, A., K. Smith, O. Dysthe, and K. Ludvigsen. 2012. “Formative Assessment and Feedback: Making Learning Visible.” Studies in Educational Evaluation 38 (1): 21–27. https://doi.org/10.1016/j.stueduc.2012.04.001. DOI: https://doi.org/10.1016/j.stueduc.2012.04.001

Hornstra, L., A. Kamsteeg, S. Pot, and L. Verheij. 2018. “A Dual Pathway of Student Motivation: Combining an Implicit and Explicit Measure of Student Motivation.” Frontline Learning Research 6 (1): 1–18.

Kauffman, H. 2015. “A Review of Predictive Factors of Student Success in and Satisfaction with Online Learning.” Research in Learning Technology 23: 1–13. https://doi.org/10.3402/rlt.v23.26507. DOI: https://doi.org/10.3402/rlt.v23.26507

Lindsay, S. 2015. “What Works for Doctoral Students in Completing Their Thesis?” Teaching in Higher Education 20 (2): 183–96. https://doi.org/10.1080/13562517.2014.974025. DOI: https://doi.org/10.1080/13562517.2014.974025

Makhanya, M. S. 2016. “Reflections on Special Issue of Distance Education.” In “Growing Capacities for Sustainable Distance E-Learning Provision,” edited by P. Prinsloo, special issue, Distance Education 37 (2): 237–38. https://doi.org/10.1080/01587919.2016.1188444. DOI: https://doi.org/10.1080/01587919.2016.1188444

Maringe, F., and N. Sing. 2014. “Teaching Large Classes in an Increasingly Internationalising Higher Education Environment: Pedagogical, Quality and Equity Issues.” Higher Education 67 (6): 761–82. https://doi.org/10.1007/s10734-013-9710-0. DOI: https://doi.org/10.1007/s10734-013-9710-0

Moore, M. G., and G. Kearsley. 2012. Distance Education: A Systems View of Online Learning. 3rd ed. Belmont, CA: Wadsworth.

Muilenburg, L. Y., and Z. L. Berge. 2005. “Student Barriers to Online Learning: A Factor Analytic Study.” Distance Education 26 (1): 29–48. https://doi.org/10.1080/01587910500081269. DOI: https://doi.org/10.1080/01587910500081269

Muyinda, B. P., and G. Mayende. 2013. “Pedagogical Affordances of Social Networking Sites amongst Distance Learners in Uganda.” A Paper Presented at eLearning Africa, the 8th International Conference on ICT for Development, Education and Training, Safari Court, Windhoek, Namibia, May 28–31, 2012.

Nesbit, J. C., K. Belfer, and J. Vargo. 2002. “A Convergent Participation Model for Evaluation of Learning Objects.” Canadian Journal of Learning and Technology 28 (3). https://doi.org/10.21432/T25C8C. DOI: https://doi.org/10.21432/T25C8C

Petrović, J., P. Pale, and B. Jeren. 2017. “Online Formative Assessments in a Digital Signal Processing Course: Effects of Feedback Type and Content Difficulty on Students Learning Achievements.” Education and Information Technologies 22 (6): 3047–61. https://doi.org/10.1007/s10639-016-9571-0. DOI: https://doi.org/10.1007/s10639-016-9571-0

Price, M., J. Carroll, B. O’Donovan, and C. Rust. 2011. “If I Was Going There I Wouldn’t Start from Here: A Critical Commentary on Current Assessment Practice.” In “Assessment of Vocational Competence in Higher Education,” edited by L. Baartman and E. Braun, special issue, Assessment and Evaluation in Higher Education 36 (4): 479–92. https://doi.org/10.1080/02602930903512883. DOI: https://doi.org/10.1080/02602930903512883

Prinsloo, P. 2016. “(Re)Considering Distance Education: Exploring Its Relevance, Sustainability and Value Contribution.” Distance Education 37 (2): 139–45. https://doi.org/10.1080/01587919.2016.1188445. DOI: https://doi.org/10.1080/01587919.2016.1188445

Ryan, R. M., and E. L. Deci. 2017. Self-Determination Theory: Basic Psychological Needs in Motivation, Development, and Wellness. New York, NY: The Guilford Press. https://doi.org/10.1521/978.14625/28806. DOI: https://doi.org/10.1521/978.14625/28806

Salmon, G. 2013. E-Moderating: The Key to Teaching and Learning Online. London: Routledge Falmer.

Schunk, D. H., J. L. Meece, and P. R. Pintrich. 2013. Motivation in Education: Theory, Research, and Applications. 4th ed. Englewood Cliffs, NJ: Prentice Hall Merrill.

Sewell, J. P., K. H. Frith, and M. M. Colvin. 2010. “Online Assessment Strategies: A Primer.” MERLOT Journal of Online Learning and Teaching 6 (1): 297–305. https://jolt.merlot.org/vol6no1/sewell_0310.pdf.

Shemansky, O., and D. Seignior. 2020. “The Value of Online Education: How Teachers Can Boost an Engaging Student Experience.” Melbourne Graduate School of Education, June 10, 2020. Accessed September 30, 2023. https://education.unimelb.edu.au/news-and-events/news/2020/the-value-of-online-education-and-how-teachers-can-boost-an-engaging-student-experience.

Shepard, L. A. 2000. “The Role of Assessment in a Learning Culture.” Educational Researcher 29 (7): 4–14. https://doi.org/10.3102/0013189X029007004. DOI: https://doi.org/10.3102/0013189X029007004

Shin, D. 2014. “A Socio-Technical Framework for Internet-of-Things Design: A Human-Centered Design for the Internet-of-Things.” Telematics and Informatics 31 (4): 519–31. https://doi.org/10.1016/j.tele.2014.02.003. DOI: https://doi.org/10.1016/j.tele.2014.02.003

Shute, V. J., and Y. J. Kim. 2014. “Formative and Stealth Assessment.” In Handbook of Research on Educational Communications and Technology, edited by J. Spector, M. Merrill, J. Elen, and M. Bishop, 311–21. New York, NY: Springer. https://doi.org/10.1007/978-1-4614-3185-5_25. DOI: https://doi.org/10.1007/978-1-4614-3185-5_25

Silver, M. S., and M. L. Markus. 2013. “Conceptualizing the Sociotechnical (ST) Artifact.” Systems, Signs and Actions 7 (1): 82–89.

Simon, B. 2019. “The Effect of Formative Assessment on Student Motivation and Self- Regulation.” MA diss., Concordia University, St. Paul. https://digitalcommons.csp.edu/teacher-education_masters/2.

Soumana, A. O., and M. R. Uddin. 2017. “Factors Influencing the Degree Progress of International PhD Students from Africa: An Exploratory Study.” Üniversitepark Bülten 6 (1): 79–94. https://doi.org/10.22521/unibulletin.2017.61.7. DOI: https://doi.org/10.22521/unibulletin.2017.61.7

UNISA (University of South Africa). 2016. “Unisa Department of Institutional Statistics and Analysis (DISA) 2012–2013.” Requested statistics from DISA, University of South Africa.

UNISA (University of South Africa). 2018. Open Distance-Learning Policy. Accessed October 5, 2023. https://www.unisa.ac.za/static/myunisa/Content/Student%20affairs%20&%20SRC/Documents/SRC%20Important%20Policy%20Documents/Policy%20-%20Open%20Distance%20e-Learning%20-%20rev%20appr%20Exco%20of%20Council%20-%2010.12.2018.pdf.

Vambe, M. T. 2005. “Opening and Transforming South African Education.” Open Learning: The Journal of Open, Distance and e-Learning 20 (3): 285–93. https://doi.org/10.1080/02680510500298816. DOI: https://doi.org/10.1080/02680510500298816

Vargo, J., J. C. Nesbit, K. Belfer, and A. Archambault. 2003. “Learning Object Evaluation: Computer-Mediated Collaboration and Inter-Rater Reliability.” International Journal of Computers and Applications 25 (3): 198–205. https://doi.org/10.1080/1206212X.2003.11441703. DOI: https://doi.org/10.1080/1206212X.2003.11441703

Vonderwell, S., X. Liang, and K. Alderman. 2007. “Asynchronous Discussions and Assessment in Online Learning.” Journal of Research on Technology in Education 39 (3): 309–28. https://doi.org/10.1080/15391523.2007.10782485. DOI: https://doi.org/10.1080/15391523.2007.10782485

Wafubwa, R. 2020. “Role of Formative Assessment in Improving Students’ Motivation, Engagement, and Achievement: A Systematic Review of Literature.” The International Journal of Assessment and Evaluation 28 (1): 17–31. https://doi.org/10.18848/2327-7920/CGP/v28i01/17-31. DOI: https://doi.org/10.18848/2327-7920/CGP/v28i01/17-31

Weurlander, M., M. Söderberg, M. Scheja, H. Hult, and A. Wernerson. 2012. “Exploring Formative Assessment as a Tool for Learning: Students’ Experiences of Different Methods of Formative Assessment.” Assessment and Evaluation in Higher Education 37 (6): 747–60. https://doi.org/10.1080/02602938.2011.572153. DOI: https://doi.org/10.1080/02602938.2011.572153

Wu, Q., and T. Jessop. 2018. “Formative Assessment: Missing in Action in Both Research-Intensive and Teaching Focused Universities?” Assessment and Evaluation in Higher Education 43 (7): 1019–31. DOI: https://doi.org/10.1080/02602938.2018.1426097

Zhang, Z., and R. F. Kenny. 2010. “Learning in an Online Distance Education Course: Experiences of Three International Students.” International Review of Research in Open and Distance Learning 11 (1): 17–36. https://doi.org/10.19173/irrodl.v11i1.775. DOI: https://doi.org/10.19173/irrodl.v11i1.775