Thursday, 2 September 2021

Growing Social Presence in Online Courses

by Andrew Moshirnia, Department of Business Law and Taxation


The need to establish rapport in a classroom is paramount. The class-as-unit is a social organism, to be tended and maintained, with the goal that instruction may be enriched with responsive learners and innovative peers. But in this environment, how can we cultivate social presence without the benefit of physical presence? We already use discussion fora and other technologies to create opportunities for interaction, but here are five additional ways to grow social presence and hopefully make your units less anonymous and your Zoom calls less barren.
 
1. Stressing (and re-stressing) the Importance of Turning on Webcams (and addressing the legitimate concerns of students who do not wish to do so)
The number one concern that I field is that students are refusing to turn on their webcams. I take this head on, by devoting time in my first class to walk through four different motivations for turning on webcams: Etiquette, Business Skill, Student Satisfaction, and Personal Appeal. I also do a quick training on how to turn on a virtual background. I return to this topic frequently, usually at the start of every class, and results have been good. I also tailor webcam policy to increase the comfort of students who are willing to turn on webcams when speaking, but often are reluctant to leave cameras on throughout the lesson.

 

2. Pre-class Inventory
You can begin building a social connection before the unit starts (or alternatively in the very first week of the unit) by using a pre-class interest inventory. By email or the unit Moodle, you can query students in ways to create meaningful connections. Below is one that I use:

  • How does this unit fit in with your course of study? (If you are coming from a technical field that taught you system analysis as part of system or product design, please let me know here).
  • What is the best thing you remember learning about last year?
  • How do you learn best? What have teachers and professors done in the past that helped you to learn?
  • If you are reluctant to turn on your webcam during class, what adjustments can I make to encourage you to turn it on?
  • Please tell me anything else you think I should know about you (for example, preferred pronoun or title, specific learning need, area you want to improve, etc.)  
3. Creating Quasi-interactive Lectures
As many instructors are using pre-recorded lectures, it is important to sprinkle quasi-interactive moments in those recordings. Recording short welcome- and exit-videos provides this opportunity. In my welcome videos, I respond to student queries (creating a sort of call-in show vibe) and share a little story or fact that is on my mind (for example, wishing my students a happy Nowruz). Exit-videos are also helpful in summarising the lesson and setting up interest in the coming lesson.

4. Check-in / Mid-SETU
We have no doubt encountered SETU comments at the end of the year that we lament: “You should have told me that during the semester!” Thankfully, there is a easy cure: we do not need to wait for official SETU’s to ask SETU-type questions. I do a mid-sem SETU and make adjustments accordingly. Students are often delighted that a stray comment from them motivates a change.

5. Ice-breaker / Sponge Activities
During synchronous activities, It can be helpful to prime students to respond and also to give them a motivation to be on-time. I often ask students a random question for mass response in text: what’s your favourite dessert, type in your favourite movie quote, etc. This recruits attention and also creates a learning moment for how to use communication tools.

Monday, 19 July 2021

A New Journey: Hybrid Concurrent Teaching

Since S1 2021, a relatively new teaching mode has been introduced in Monashto to cope with the new scenario of the pandemic. In those classes, some students attend a workshop in a physical classroom while others attend via video conferencing (eg Zoom) at the same time. Teachers have to deliver synchronous learning occurring at the same time for both on-campus and remote participants, known as Hybrid Concurrent Teaching.

In this new model, every student is able to have the same opportunity to receive identical information from their teachers in real-time, discuss with their peers and teachers, and complete in-class learning activities synchronously.

This new mode allows all students to connect with their educators and peers at the same time. With the hybrid model, every student is able to get the same information presented by the educator at the same time. Students are all given the same opportunity to participate in class discussions and to participate in online-class activities synchronously. 

Despite its benefits, it also presents some new challenges to our teachers who most likely have never done that before. I know that I have never done that before! What should we do? MEA has prepared some interactive teaching scenario demonstrations on their website. And I am also preparing myself for working with such a unit in the coming semester.


Design and preparation

Other than the general principles for designing an engaging unit, some special considerations can be given to the following items:
  • Prepare a detailed session plan. Here are some examples from MEA:
  • Design how students in each cohort will ask questions and how both the question and answer will be communicated with other students if necessary.
  • Plan simple learning activities before advancing to the complex ones
  • Consider pre-recording most of the contents for students to view before the face-to-face sessions.
  • Plan extra time for:
    • Technical preparation
    • Time to socialise: ice-breaker, fun activities ...
    • Multiple mini-breaks


Teaching activities in the classroom

After attending MEA's hybrid teaching technical training session in the classroom that has a presenter camera with Zoom enabled, I have a better understanding of the technical requirements of the class (e.g. it is very important for all students to bring their own laptops and headsets) and which teaching activities might be suitable for the scenario.
  • Easy ones:
    • Demonstration
    • Polling
    • Quizzes
    • Presentations
  • Not so easy ones:
    • Group discussion
    • Collaborative whiteboard activities
    • Students to create resources
    • Group projects
MEA has prepared some questions to consider when you design those learning activities.


To mix or not to mix?

But the ultimate question for hybrid concurrent teaching might be: whether I should mix the on-site and online students in groups? Well, I have asked the same question to myself. 

Of course, you want to provide an equal learning experience for online and face-to-face students. In addition to asking everyone to join Zoom with the camera on and a headset, you want to mix them in groups in group activities. However, MEA strongly suggests we not do that. They even write that in BOLD in their guide. That is to avoid technical issues such as audio feedback.

I have not done such a test with everyone joining Zoom with a headset in one room. I guess things can get messy in a classroom with students' laptops, your mic, and the classroom speakers. Maybe it is better not to try mixing the face-to-face and online students and follow the MEA guide.


What is your experience?

What have you experienced in your hybrid concurrent teaching? What worked and what did not? What you are going to change in your teaching? Please leave a reply or share your story with us.

Tuesday, 29 June 2021

Example of excellence - Role-play in Accounting

In 2019, I had the pleasure of observing a very engaging and authentic form of assessment in Damien Lambert's class: role play based on storyboards of auditing scenarios that students have created. 

In this assignment, students are to demonstrate their understanding of the processes and activities involved in the planning, performance and conclusion of a financial report audit through the creation of a hypothetical scenario. The assignment also aimed to help students develop key skills and attributes of a effective auditor, according to a survey by Forbes and KPMG (2015):

This assessment format has been implemented in many Auditing and Assurance units, not only at Monash campuses but also in a graduate audit unit at San Francisco State University. With its four-year history and counting, this assessment has become a remarkable tradition. 

This year, I caught up with Damien, Ashna Prasad and Lisa Powell to learn more about how they have managed to successfully facilitate role play when students are not physically in the room. The answer is, unsurprisingly, technology. More specifically, empowering students to showcase their creativity through the use of technology. 

Which aspects of assessment design have stayed the same? 

  • Students are in groups of 4-5 members
  • Provision of written instructions
  • Detailed marking guide for storyboard (group) and role play (individual and group evaluation)
  • Group activities to help students connect with group members and build rapport
  • Role-play/presentation tips videos created in collaboration with Monash Centre of Theatre and Performance
  • Visual illustrations and visual performance art workshop run by a professional artist

What's new?

  • Hybrid cohort: some groups met face-to-face, and some worked completely online
  • Format of the role play performance: video submission, instead of live performance
  • Instructional videos for the assessments and other resources
  • Sample storyboard to demonstrate exemplars
  • Feedback Fruits used to facilitate peer evaluation
  • Students experienced less stress and anxiety of role-playing live, while showing more creativity through the creative process of making videos. 

Show time!

Here are some highlights from student performances. Enjoy!


These snippets of student role play are a testament to the power of students' creativity when they are given the space, guidance and autonomy to express it. The team and other colleagues have also written a paper about their teaching practice, and highlighted "enhanced creativity and human skills", as well as "high levels of engagement, motivation, and enthusiasm" among students. 

"Creativity in intelligence having fun." 

Albert Einstein

It goes without saying that contextualised and creative forms of assessment bring about challenges in terms of time, resources and student reception. Upon reflection, the team shared about a small minority of students who struggled with the lack of structure and ambiguity from the revised assessment format (Powell et al., 2015). Improvements such as more visual aids, video demonstrations and scaffolding towards dealing with ambiguous situations and uncertainties are in store for future student cohorts. 

How have you innovated to transform your teaching for a hybrid or online environment? We'd love to hear about your experience in the comments below. 

Friday, 22 January 2021

2021, A Year in Sight

Following on from the post at the end of last year, here is a reflection on things that academics had success with during 2020 and will continue to work with in 2021 or something they'd like to explore.


How TaLT Provided Support


Without tooting our own horn too much - it was important during these 'interviews' to find out how we, as TaLT, could improve our support to academics. During this process, there was much gratitude and affirmation. We felt it was important to share so that you may be inspired to consider the different ways the Faculty Educational Designers can work with you.

Every academic that was asked stated they felt "very well supported" by their departments Educational Designer (ED), along with all the TaLT resources.

And although some stated they felt guilty reaching out to the ED - because they thought they were doing so 'too often' - they knew they were welcome to do so, given that the convenience of a quick Zoom meeting was within reach.
These Zoom meetings often went beyond just the immediate problem at hand - but deeper conversations around assessment strategies and pedagogical approaches for different elements of the unit.

2020 required a complete rethink on approaches to teaching and learning; and so the ED would often provide suggestions on new things to try - as conversations would often highlight deficiencies or areas that could be improved with new tools or strategies. Many academics shared they felt some level of apprehension in adopting some of these - but that they felt comfortable and confident in trying knew things (at the encouragement of the ED) knowing they were not going into it alone and that the ED was there supporting them along the way - always ready to support the acaedmics in a timely manner should something happen.

Moodle was a key focal point of 2020 - as it became the primary medium of communication for students. Some felt that Moodle was such a complicated beast that it was daunting to try and make any meaningful change in the limited time frame available. However, in talking to the academics, quite a few stated that although they were initially resistant to making any sort of change in Moodle, they were encouraged by partaking in or watching recordings of various workshops run by TaLT, and that the ED was there supporting them along the way. The Faculty Moodle Team also provided invaluable support when things got more technical - and were quite responsive to most requests.

The TaLT Newsletter was also highlighted as really useful resource - with links to articles or other media that could inspire or challenge conventional thinking or approaches. One criticism was that sometimes the content came a little delayed (eg. one newsletter focusing on assessment would've been nice to have prior to semester) - and we acknowledge it's hard to time and release these in a way that suits all. However, we will endeavor to work on this for future Newsletters.

The 1-on-1 sessions provided great opportunities to have a focused discussion on a particular area or topic; with many wishing to have more of these in the future to discuss and plan their units - which we are always happy to do.

So if you would like to have a chat to discuss plans for the future, new tools or strategies, or even some big, blue-sky thinking: Don't hesitate to arrange a discussion with your departments Educational Designer.



Looking forward: 2021 and beyond


Given the experience from 2020, it's not surprising that through discussions with other colleagues, reading articles, attending virtual conferences, seminars, and symposiums - many academics have had their interest piqued in adapting existing practices or finding new ways to teach or engage students. Here is a brief breakdown of some of the things shared:


Although the university has been encouraging it for some time - it seems that the 'blended' or 'flipped' approach to learning will now become the norm for many units, with academics sharing that they will reuse their pre-recorded videos as much as possible; primarily because the presentation of the slides and content works better compared to a lecture theater presentation (or recording). 

Moodle

Many feel their Moodle layout worked well - and so will keep this. Along with reusing the various resources, updating the content as appropriate and if possible. Thus, many plan on continuing to do what they did in S2-2020.

Others, however, have identified a deficit - be it in the resources or activities - and so want to focus on creating deeper learning opportunities as they explore deepening the online experience students have. Particularly around better integrated multimedia resources, and creating more self-directed activities. One such area that was mentioned was exploring the use of integrated quizzes into the asynchronous (onDemand) videos through Panopto.  

In-Person Experiences

Some academics noticed that the 'dual-mode' students seemed more engaged than those learning purely online - and so will look to leverage the 'in person' experience more going forward. Part of this focus includes (re)designing the tutorial activities to provide more reflection and low-stake assessment of the students, as well as encouraging more discussion at a deeper level.

Additionally, to give some more authentic experiences to the students, some would like to consider a 'research day' type of assessment, tied to a poster presentation - so that students can present (and thereby practice another professional skill) and also learn what many academic conferences are like with regards to posters and presentations in general.

Assessment

This was one of the biggest areas of challenge - particularly with assessments focused on the entire units content. At least half of the participants talked to mentioned bringing back exams for different reasons. A couple of the academics mentioned the need for examinations for integrity and trust. Some actually felt that the past exams were easier than the modified assessment task, as it became much harder for the students to complete successfully. 

There's also a desire by many to find effective ways to provide additional marks for participation and engagement by students, based on specific group activities. Including some more 'profession' based ones, such as how to write an email (especially given the nature of communication in 2020, it became clear that many students lacked certain professional skills in this area). 

Video (or audio) based feedback was another area that is being considered by many; and we encourage exploring the Feedback for Learning site to discover what tools and strategies work best, and students respond to most positively.

One tool that many mentioned either using (and planning to use more in 2021) or want to adopt in 2021 is Perusall:


Perusall is a free social reading platform integrated into Moodle which allows students (and teaching staff) to digitally annotate readings and videos collectively and respond to each other’s comments and questions. It creates an environment for online collaborative reading and discussion and provides auto-marking of student comments and the analytics which will enable you to see not only who has completed the set readings but also to measure their interaction with the text.

Feedback on the use or Perusall has been quite positive - with one academic reporting that its use lifted the overall grade by around ~10 marks. This is because key concepts learned in papers (which historically wouldn't have been read by students) now were being read, because of the associated additional marks in responding to other students comments. Which, in turn, meant that students were prepared for the assessments and could respond accordingly.

Zoom

A critical component of education - and teaching - is the formation of relationships; the use of Zoom consultation sessions helped many in 2020 to get to know and build on the educational relationships between lecturers and students. Due to its relatively ease of use and ubiquity - many will continue to use Zoom for 'virtual office hours' and consultation. A couple even mentioned making these consultation sessions compulsory - as it would allow a regular point to touch base with students, check in, and address any issues - or direct them to resources or support as necessary.

Health and Wellbeing

One area that became very important - and was heavily discussed in social media, news sites, and by Monash Health and Wellbeing - was the importance of a 'good' work-life balance. Working from home has made it a lot harder to separate the work from the personal, and many shared that they felt they were working much longer and much harder than in the past. Whilst this makes sense, most people that were asked stated that they will spend 2021 being kinder to themselves and trying to put in place some strategies to break up work from home.


Here ends the reflection and planning for 2021. We hope that this has been informative, and that you have been given some thing to consider for the future. Remember to reach out to your departments Educational Designer should you want some consultation - or just someone to brainstorm ideas with.

Good luck for 2021!


Tuesday, 22 December 2020

2020, A Year in Review

 

Well, you made it. We made it. Together, we have reached the finish line - and there is now a warming light that is wrapping its arms around us as we exit the tunnel (and no, it’s not the on-coming TaLT train!).

2020 has been a tough and rough year - and for many, that may seem like an understatement. There has been much learning that took place - and some academics were willing to sit down and share their thoughts. Buckle up - because this is going to be a long one (separated into two blog posts in fact!) - but I'm hoping you will be nodding along in agreement - and hopefully inspired by some peoples work! 

They have shared the highs and lows from their experiences and compare semester 1 and 2 in a variety of ways.

Note: This post is focused on Semester 2 - for comments on Semester 1, check out this post here.


The Good (Wins)



Although difficult and involved, the adaptation to 'Emergency Remote Teaching' in second semester was made somewhat easier by the fact that many academics had either gone through Semester 1 and had learned what works and what didn't - or they could rely on the feedback and guidance from those who had.

In reflecting on the year in general, most have found the situations forced the learning of new skills and growth in areas previously not sought out (due various constraints, including time) but which has now made them more comfortable and confident with trying new things - especially those that involve technology. 

Moodle

Moodle was one of those pieces of technology that many people have used over the years, but to different degrees and with subsequently different results. After Semester 1, many knew they had to re-work their sites. One academic with whom I worked to assist in redesigning their Moodle site said "Moodle can be exciting and work well". Where there is clear navigation, clear signposting, and a clear learning pathway - students found that they could navigate the site easily enough to find the information they were looking for. For some units, this dramatically cut down on the number of emails they would usually get during a semester - most of which would normally be students looking for resources on Moodle.

A critical component to all this is being consistent between the weeks, and the nature of the content that students would be experiencing throughout the semester. This didn't mean having the exact same type of thing in the same order each week - but that students would be introduced in the first two weeks to the type of content they would experience throughout the semester helped to focus them and assuage anxieties around the unit or method of delivery / consumption.

Through shifting the focus from a more traditional 'synchronous' manner, many academics have found a new energy and preference for more 'asynchronous' teaching - where students do more in their own time as it suits them - particularly in post-grad contexts or where the student cohort is older with more life responsibilities to try and juggle. Through exploring this 'different' model, one academic noted they now have a "new respect for Moodle and its functionality". In particular, keeping an eye on making Moodle clean and clutter free to assist in keeping things as simple as possible for 2020 - the students responded overwhelmingly positively.

Asynchronous Video Content

The synchronous experience formerly known as 'the lecture' was replaced in many units by pre-recorded videos. However, like everything in 'remote teaching', this couldn't just be a 1:1 replacement. Two hour blocks of video weren't really going to cut it for the students, but then lay the challenge of how best to structure and present the information necessary for students to understand key concepts and ideas in a clear and concise manner.

Whilst this wasn't entirely new to many (at least conceptually) the implementation was; and for some it was a challenge to 'get right' first time through. Some found they rambled too much, while others disliked the amount of mistakes they made (again, allowing some mistakes has been found to be good for building rapport with the students; too many in quick succession might be an issue though). Where some avoided using a script - as they felt it encouraged too much perfection - some others found it helped to focus the videos, avoiding the ranting and rambling.

TaLT encourages the use of intros and outros to weeks (as appropriate) - so as to bookend the learning (explaining what the week entails, and then recapping what was learned and addressing any issues identified during the week with misconceptions etc). Some found that using a video format for these resulted in a positive response from the students, and that information that might have historically been overlooked was now being consumed.

Although Panopto was the preferred video hosting solution (as it allowed students in China to be able to watch the videos) some opted to use YouTube - as its auto-captioning feature worked more reliably and accurately. This also made it easier to share unreleased videos to students that would guide or assist them with their assessments for the unit.

As a result of the overall positive experience in creating these videos, and the reception by most students - many academics stated they "don't foresee ever giving a lecture in person ever again".

TIP: If you do choose to use YouTube, make sure to check in with students to ensure they're able to access the videos as necessary.      

Synchronous Video Delivery

One of the technological advances in 2020 was the use of Zoom - and it extended from merely 'online meetings' to now being used for synchronous lectures and tutorials. Many adapted tutorials to be delivered through zoom as 'seminars', relying on TA's (where available) to facilitate or purely run these sessions solo.

It was in the older group of students - particularly in post-grad courses, where the synchronous video-based delivery and discussion of content really shone. As they were more willing to have their own cameras turned on, and engaged more frequently with each other. This helped build and shape a community between the cohort - to the point that they still met during the semester break to have a 'zoom with wine' catch-up session.

Pedagogy

Because of the rapid shift in Semester 1, the pedagogy took a back seat in many units purely out of necessity: there was very little time to think deeply and careful on how to adapt to an online mode of delivery. Semester 2, however, provided slightly more time to prepare and adapt. 

Not everything can easily translate to an online format - and many have expressed struggles with this, with lots of comments on further thinking and research required to more effectively adapt the content and knowledge the academics are comfortable with into meaningful online formats or interactions.

Although H5P is a popular tool - it can also become quite burdensome in the time it takes to create a single activity, especially if considerations are made beyond the surface level of what the activity is doing. Thus, the use of forum posts with individual responses from academics and TAs was found to work just as well for an asynchronous activity - and the students responded positively to this also.
And it's through these types of asynchronous activities that students reported feeling a better connection to their cohort, with academics echoing similarly. It's very easy to lose track of the students you are teaching when in an online setting - so trying to leverage any form of activity that can help build a better connection or understanding of the students you are working with is critical.

One academic adopted a tick-tock approach, where one week was more content filled and 'harder' and the following week more reflective and 'easier'. Students voiced much satisfaction with this model, as it allowed them time to breathe and catch up with the work, whilst also allowing them to prepare mentally for a particular week to be harder or easier.

Academic life

It's no secret that there are academics in each department that are seen as champions in some area of teaching - which can often make those making their own smaller progresses feel underappreciated.
However, something that was brought up was the collegiality that was really grown during this past year. Some attributed it to the fact that we were all in this together - it was (by and large) a level playing field; and this meant there was more confidence in sharing failures, and openly sharing with each other tips and suggestions on what has worked in their unit with others having issues. 

A side effect of using Zoom for teaching is how much more adept and confident everyone has gotten at scheduling and joining Zoom meetings - even if they often start off as a modern seance. This has meant a more inclusive and accessible means to talking to colleagues - who historically were separated by time and space (that is, different campuses with competing schedules).  

And not only were academics kinder and more supportive to each other - many were also kinder to the students. Where they may historically been more direct with the students, the academics recognised that students were also doing it tough, and so would be kinder, more patient, and extra sympathetic to them.


The Bad (Challenges)


Some say you cannot know the good without the bad, and it's only through the experience of both that you can objectively identify each. So here are some related negative experiences to consider for future teaching: 

Moodle

In many ways, Moodle itself wasn't the hardest part of semester 2 or 2020. The use of it, however, was. In running reports, some academics found that student's weren't using the site completely - and weren't accessing or engaging with many of the resources. This was really disappointing to the academics as they had spent considerable time to restructure the Moodle site, including finding more appropriate resources that were up-to-date and effective given online only teaching. Some even went the route of creating even more teaching resources to support the students who were struggling as the content got harder. Even then, very few engaged with the content designed explicitly for them. Outside the university's and academics control was also the fact that some students had issues with internet connectivity and thus accessing content in general.

Asynchronous Video Content

Whilst many embraced the Asynchronous video creation - it wasn't without its challenges. Chief among the issues raised was the amount of time it took to rework traditional lectures to the new delivery mode (and we commend all who consider this change of delivery). Another component to it was that some would get caught up in a pursuit of perfection - redoing sections of a video that was felt unclear or maybe had too many verbal stumbles. Something that helped some academics was the creation of a script - since most of their videos didn't show their face, only the slides - with only the intro and outro slides showing the academic. This meant that they could rely on the script to focus on pronunciations and that the information was clearly and definitively presented. This script would take an additional 6 hours or so to create for a standard 30 slide presentation (possibly a little long in TaLT's opinion) - however, it made the creation of the video much quicker and easier. It also helped remove some of the anxieties in creating the videos and thinking about phrasing of the information.

Synchronous Video Delivery

After the Semester 1 issues with Zoom were resolved, Semester 2 saw more academics presenting seminars and tutorials through Zoom. However, many found that students (particularly undergraduates) wouldn't turn on their camera's - which of course makes it difficult to build a connection or rapport with the students, and also makes one consider if they are even there. Some even suspected that many weren't even listening as there was no engagement in the chat or audio conversations from many students. Because of this lack of relationship with the students, one academic actually said it was easier to fail the students. Another acknowledged that whilst its easier to access a lesson through Zoom, it was no different to students not turning up to lectures or tutorials 'in real life'; students will always be students, and that we should treat them as adults. 

While trying to adapt a tutorial that has successfully been run in person in a classroom, one academic noted that in person it's a lot easier to keep things flexible and dynamic - but through Zoom needed to be much more structured and didactic. This is true for 'observing' students in groups too - as entering breakout rooms will often kill the dynamic going on, whereas in a classroom a teacher can stand off to the side and focus on different groups from a distance. 

Critically, some units rely on guest lecturers from industry coming and giving talks / seminars around key topics to demonstrate application of knowledge and practice. However, many were not comfortable with either pre-recording a video for students to watch, or attending a Zoom seminar (which would be recorded) as they saw this as creating free content for the university which would then also belong to the university.

Pedagogy

Perhaps one of the biggest areas of challenge has been around the pedagogy. There was the pressure of not wanting to change the unit too much as there was much discussion and focus on returning to "normal" in Semester 1, 2021. Given the online nature, this is heralded often by many as more flexible for students - but it was acknowledged by many that the big challenge was finding a balance between facilitation of learning and encouraging independent learning. Engagement issues were probably the biggest points of discussion and pain for 2020 in general - and given everything that was going on, and the struggles students were facing (including all academics - and everyone in the world in general) it's understandable why they may have had difficulty with motivation or engaging with the learning materials. 

One unfortunate factor of some units is that students either love them or hate them - and this factors in greatly with their motivation to engage with the unit.

Outside of engagement, the other problem was the types of assessment that could be given to the students - as given certain subject areas, there were limited options for effective assessment of the students knowledge and understanding. Many exams moved to become open book - which possibly made it too easy for some units; and other units found that assessments did not translate well, and in fact became too difficult (as the weighting and requirements increased due to the removal of the end of semester exam). For this reason, many mentioned that they will be reintroducing exams as soon as they are able to for a host of reasons.

Academic Life

Second only to the pedagogical challenges was the impact to the individual academics in a variety of ways. Those who taught in both Semester 1 and 2 (especially those doing Winter subjects too) found that didn't have time to prepare for Semester 2 - including a lack of time to review the content from previous iterations of the unit.

A number expressed working many days and nights - and were especially worried in trying to make a positive experience for first year students, and ensuring they had good performance  in the unit. In fact, one academic that taught both semesters mentioned that they worked in some capacity 7 days a week (including the week before and after semester). Because of these constraints, many felt they couldn't spend time to learn and master much of the 'tech side' of things. When various technologies were utilised - such as H5P - some found them to be under-used or completely ignored by the students, which has made the academic question the value or purpose of such tools. 

Various pressures around budgets and value of teaching were also expressed - which caused additional anxieties and uncertainties around the teaching of units or entire courses - or even the location of the teaching; allocation of TAs and allowed hours made the administration of units with large cohorts much more difficult. Compounding this was the pastoral difficulties with these same large cohorts - with students trying to play the TA and CE off each other in one unit, through to many complaining about rude and disrespectful emails from students demanding remarks or questioning the grade on the various assessment tasks.


How did the semesters compare?



If you ask for feedback - or feedback opportunities are presented - those who have had a negative experience will be more likely to take the time to share about it. Students had a lot to say during, and in reflection of, Semester 1. However, academics also noticed quite a few difference between semesters.

Semester 1 was better

In some cases, academics found Semester 1 to be better for a variety of reasons - including having more support with TA's and associates, which could provide a more 'team-teaching' approach to content delivery. However, as budgets were tightened up as the year wore on, many lost this additional support - or had hours allowed dramatically cut, leading to some academics spending as much as 9 hours a day doing teaching on their own. 

There was also a novelty factor which became a useful tool for engagement, which also saw more students using Zoom-based consultation sessions. It became very apparent going into Semester 2 that many were 'zoomed out' and just mentally exhausted from doing anything and everything through a computer screen. Given that many had to adapt quickly for Semester 1, the students tended to be a little more understanding (after a while) - but this also meant they had much higher expectations in Semester 2, so were less forgiving to mistakes.
It also appeared that students wouldn't expend any more energy than they needed to when it came to finding things or engaging online.

Semester 2 was better

Semester 2 wasn't all bad, though. In fact, some academics wound up teaching the same cohorts of students in Semester 2 - which made it easier to connect and assisted students by having a similar layout and approach on the Moodle site. 

Some units also found a smaller cohort had enrolled, which made it more manageable when it came to moderating online discussions and synchronous activities. Conversely, some had larger cohorts, and so could rely on the assistance of TAs to help manage all that had to be done. These TAs were also invaluable as sounding boards to discuss and work through complaints from students or problems identified during the teaching.

There was a lot more time to adapt to the online-only delivery method, including learning by those who hadn't taught in Semester 1 from those that did. This meant that many Moodle sites were much better organised than in the past, with a special focus on making it easier to navigate for the students using headings as signposts - especially to helpful resources from the Library.

Assessment

Changes to assessment strategies were a critical component of adapting to online delivery. Thus, some tasks which were voluntary in Semester 1 become mandatory and assessed in Semester 2. Whilst many other assessment tasks could not easily or meaningfully be adapted to an online-only context, and having learned from the previous semester, talking to academics or hearing feedback from students - some academics went the route of simplifying the assessment tasks in Semester 2. As one example noted, there was a replacement of a writing task with a series of Multiple Choice and Short Answer quizzes.

 


What next?


Here ends the first part of this two-part post. Be sure to check back early in 2021 to see what academics plans for the new year are, and to see how TaLT can help you realise your teaching and learning visions.


Tuesday, 8 December 2020

Student Peer Evaluation and Feedback in Group Project

 


FeedbackFruits is a suite of assignment tools that provide students with opportunities to give and receive feedback related to a range of assessment activities.

Some of the most useful functions that complete Moodle as an online learning environment includes

The Peer Feedback Assignment structures the process of students reviewing works submitted by other students.

The Group Member Evaluation Assignment structures the process of students giving feedback about other group members. This tool streamlines the way students assess their peers’ collaboration skills. The teacher specifies by which criteria students evaluate their peers’ contribution to group work. Additionally, teachers can require students to elaborate, by commenting on the feedback they provide their peers, thereby combining quantitative and qualitative feedback.

Further tools are available in FeedbackFruits, such as Assignment Feedback, Comprehension, Group Member Evaluation, Interactive Audio, Interactive Document, Interactive Video, and Skill Feedback. You can visit the FeedbackFruits Tool Suite for more information. 

In 2020, Monash has piloted FeedbackFruits to support assessment, feedback and interactivity in some units. Dr Jess Co from Management had a successful initial pilot in her unit MGC1010 in S1 and S2 2020. And she presented her experience in the showcase webinar organised by MEI. It encourages more academics to join the trial. In S2 2020, Jessica Fritz and Holly Dillabough successfully adopted the Group Member Evaluation tool in their unit BEX5200. Their assessments provide students with a chance to learn how to give, receive and react on constructive feedback on their communication and teamwork skills.

For teachers, Group Member Evaluation provides insights into the collaborative process, thereby tackling the problem of free-riding. Peer-assessment is crucial to develop students' empowerment, confidence, and the ability to self-evaluate and reflect. On the other hand, Group Member Evaluation provides teachers insights into the collaborative process, thereby tackling the problem of free-riding. Peer-assessment is crucial to develop students' empowerment, confidence, and the ability to self-evaluate and reflect.

As Monash might stop paying for the similar tool CATME in the future, FeedbackFruits might be a good choice to continue doing peer evaluation and feedback in student group work. If you are interested in that as well, please feel free to get in touch with us, and we can have a chat. Here is a presentation recording of our colleague Jess with about her journey with the Feedback Fruits Group Member Evaluation tool.



Friday, 9 October 2020

The Scholarship of Teaching and Learning

My journey with the Scholarship of Teaching and Learning (SoTL) started serendipitously. 

In January 2019, I got a ping in my inbox. A forwarded email about a "call for applications for the 2019 ISSOTL International Collaborative Writing Group". If you are unfamiliar with ISSOTL (International Society for the Scholarship of Teaching and Learning), they are an organisation that "serves faculty members, staff, and students who care about teaching and learning as serious intellectual work... and fosters scholarly work about teaching and learning" (ISSOTL, n.d.).


One of the proposed research topics caught my eye, "Investigating boundary crossings within SoTL collaborations". I took my chances and applied to be a part of an International Collaborative Writing Group. Almost two years and two manuscripts later, I am still a part of that writing group and the amazing larger community of SoTL colleagues. 


If you are wondering "What is SoTL?", I had the exact same question when I saw that email back in 2019.  


What is SoTL? 


SoTL work involves
"... the habits of asking questions, gathering evidence of all different kinds, drawing conclusions or raising new questions, and bringing what they learn through that to… students’ learning."

This video series produced by ISSOTL and Elon University’s Center for Engaged Learning can offer more insights on the field of SoTL. 

Why does SoTL matter? 


The landscape of higher education has gone through a year of unforeseen challenges and has had to respond with significant pedagogical and technological shifts. Most students and teachers are navigating this uncharted territory for the first time.

Have you had any of the following thoughts in the past few months? 
"Are the new teaching approaches effective?" 
"Are students watching the recordings and interacting with the learning materials?"
"Are you students enjoying the class?"
"How do I get students talking and keeping them engaged?" 
"How do I get students to work together online?" 
If so, you are not alone. It is natural to be curious about what your learners are going through, and whether the implemented changes are effective. And that natural curiosity will ultimately benefit your learners and their learning experiences tremendously. 

It is now a better time than ever for educators to reflect on their practices, to ask questions and seek answers that benefit students in your cohort and beyond. 


How to get started on your own SoTL journey? 


Talk to someone. It is THAT simple to get started. 


In fact most radical changes and innovative ideas often stem from a chat with a someone down the hallway from your office, or from a coffee catchup with colleagues in your "small significant network" (Roxå & Mårtensson, 2009). These are private conversations that can often inspire bold, experimental, and even rebellious ideas against the conventional regimes in teaching (Mårtensson, Roxå and Olsson, 2012). 


As ideas from these conversations transform into investigations in your own classroom and inquiries related to your own teaching approach and practices, the results of these investigations can feed into a larger discourse. There are many avenues for the sharing of your ideas and reflections, including but not limited to a blog posts, presentations at departmental meetings, seminars, teaching and learning showcases, conferences, and peer-reviewed journals. 


Simultaneously, it is also important to build up your capabilities as an educator and ensure that your teaching is informed by research. You can do so by taking advantage of the the wealth of training and development opportunities provided by your Faculty Teaching and Learning Team (TaLT) and the Monash Education Academy (MEA). Subscribing to the TaLT's newsletter and the ISSOTL's newsletter, attending conferences and doing your own reading are also good ways to stay up to date with the literature. For SoTL literature, the Teaching and Learning Inquiry is a great place to start. 


And finally, don't forget to join a network of like-minded people who are also interested in doing SoTL. You may not only find moral support, but also your next SoTL collaboration!

1. Chat with your colleagues (academics in the department and your Educational Designer)
2. Attend training and academic development opportunities to ensure your teaching is informed by research. 
3. Investigate what is going on in your own classroom. You can conduct your own reflection and gather feedback from students.  
4. Publicly share your reflection and knowledge with colleagues in and outside of your institution and discipline. 
5. Join the SoTL community.

The following visual representation of different teaching activities by Kern and colleagues may help you reflect on your teaching activities and what you can do to start engaging in SoTL.


A closing thought

Be kind to yourself. Whether you are privately reflection on your practices, chatting with a colleague about your teaching, or adopting scholarly teaching, it is worth remembering than every journey has a beginning. Nothing you do is too small or insignificant, as long as students' learning is at the core of it.


References: 


Center for Engaged Learning. (2013, September 9). Key characteristics of the scholarship of teaching and learning. Retrieved from https://youtu.be/yvDKHHyx7YY.

Francis, R. (2007). Getting Started with SoTL in Your Classroom. International Journal for the Scholarship of Teaching and Learning, 1(2), n2.

Kern, B., Mettetal, G., Dixson, M., & Morgan, R. K. (2015). The role of SoTL in the academy: Upon the 25th anniversary of Boyer’s Scholarship Reconsidered. Journal of the Scholarship of Teaching and Learning, 1-14.

Mårtensson, K., Roxå, T., & Olsson, T. (2011). Developing a quality culture through the scholarship of teaching and learning. Higher Education Research & Development, 30(1), 51-62.

Roxå, T., & Mårtensson, K. (2009). Significant conversations and significant networks–exploring the backstage of the teaching arena. Studies in Higher Education, 34(5), 547-559.