Learning Analytics
With the growing size of the class in Monash Business School, teachers have found it is hard to track individual student learning path and maintain quality communication with them as there are simply too many students in the class. More and more communications initiated by the teachers are now sent as a general message to address all students. For example, the same messages are posted on the online forum, sent via SMS, or email to all class participants to reduce the teachers’ workload. Recently, with the innovation in educational technology, it is possible for lecturers to use information technology to draft and send personalised emails to students in bulk according to their online engagement, tutorial attendance records, and assessment results. Learning analytics allow us to identify certain student groups with different selecting criteria and reach them via personlised emails.
Zoee Cohen from the University of Arizona has also been sending personlised emails to students for year and seeing improvement in student academic performance: Small Changes, Large Rewards: How Individualized Emails Increase Classroom Performance.
TaLT has tried to answer that challenge by trialing using a learning analytics system to communicate with students with personlised Emails with one of our Business Law units in S1 2018 and the results are very encouraging.
SRES - The Student Relationship Engagement System
The SRES, Student Relationship Engagement System, empowers teachers to collect, analyse, and act on data to better engage students at scale. It was developed by built, run, and supported by a bunch of teachers primarily at the University of Sydney. Monash Biology has set up a server for those who are interested: https://sres.biol.monash.edu/
Here is a short introduction to the system:
Our trial
Last semester we have trailed SRES to send personalised emails to certain student group worked on his BTF5903 unit with 389 students. We think that it improves student engagement as well as their classroom performance. We have attached a brief report here:
Time/Event
|
Students No. Received Emails
|
Students No. Read Emails
|
Student Action
|
Week 4 before 1stassessment
|
57 students who did not do more than 4 online learning activities
|
51
|
Students finished 3.1 activities on average in the following days.
|
Week 5 after 1stassessment
|
24 students who scored 100% in the 1stassessment
|
23 (3 left feedback to consider the email useful)
|
2 students wrote back to the lecturer
|
Week 8 before 2ndassessment
|
185 students who did not do more than 3 activities in Week 5-7
|
180 (4 left feedback to consider the email useful)
|
Finished 2.1 online activities on average in the following days.
|
The mean student final grade increased by 6.7 and the median grade increased by 8 compared to the previous semester together with other unit design improvements
| |||
And here is an example of the email:
Dear XXX
I hope you are well. As you know we will hold our first major assessment for BTF5903, the Mid-Semester Feedback Test, this week.
In the first three weeks there were 8 online Lessons and Quizzes on our Moodle site that you needed to complete. We noticed that you completed 1 of them: that’s no more than 50%! Our past student records prove that those students who fail to complete half of the online learning activities by the middle of semester are TWICE as likely to fail the ENTIRE unit when compared to those who complete more than half of the online learning activities.
We strongly advise you to complete your online Lessons and Quizzes, as well as all other relevant study materials to prepare for the test in Week 4. The test result will contribute to your final grade.
Good luck and see you next week.
Regards
Lecturer
What is not so good?
The system is not integrated with our Moodle yet. We have to export results from Moodle into CSV files and then import those files in SRES.
Would like to try?
If you are interested in using that in your unit this semester, just let us know. All you need to do is to sit with us for an hour to discuss and then we will take care of the system set up, etc.
