Authentic assessment - Embedding the development of 21st century skills in your unit

What is authentic assessment?

You probably have heard of the term authentic assessment before. Authentic assessment has been increasingly adopted in higher education, and is certainly proving its relevance and value to both educators and learners.

But what is it, and why should we care?

Svinicki (2004) offers the following definition of authentic assignments:

" Authentic assignments should be based on 'student activities that replicate real world performances as closely as possible'."

Examples of authentic assessment may include simulation, role-playing, case study, creation of different forms of media, e-portfolio, you name it. The authenticity of an assessment task may be determined based on the nature of your discipline, and how well it is contextualised to reflect real work scenarios in a particular industry.

So, you may be thinking, 'is traditional obsolete?', and 'is it even possible to make all assessment components authentic?'. Those are valid questions, and my answers are 'no', and 'probably not'.
Firstly, traditional assessment such as multiple-choice questions and essay writing are valuable in evaluating students' understanding of foundational concepts, and their critical thinking to some extent.
Secondly, given the constraints in time and resources, it is not likely that every assessment task could be authentic. Therefore, it is important to think about assessment in your unit as a portfolio of assessment, containing an appropriate balance of both traditional and authentic assignments.

Why authentic assessment? 

Now, let's take a moment and reflect on our own work context. Despite the structure in place to establish our goals and ensure quality of our work, we are often given the autonomy to choose how we work, i.e. how we solve problems. We often need to provide direct evidence of our competence (performing a task), which is the essence of authentic assessment. 

"Student learning experience and development is beyond the grade they get at the end of the subject."  

(Frey, Schmitt & Allen, 2012) 

Similarly, authentic assessment requires students to perform tasks and provide direct evidence of their competence. Furthermore, by allowing students some freedom in how they can demonstrate their competence in terms of skills and knowledge, you are effectively developing students for their ability to think critically and solve problems creatively. Students may also be enabled to collaborate with their peers and communicate their work with an audience other than their grader. These are the 4Cs of many frameworks on 21st century skills, which is gaining attention and sparking meaningful conversations in Higher Education about how we should prepare our students. 

An example 

Damien Lambert and his team teaching Auditing and Assurance has had a busy S2. The team have implemented storyboard and role-playing performances as parts of their assessment for their unit. Students first get to work in teams to come up with their own work scenario for auditors, and subsequently create a storyboard for submission. Finally, they get to act out their scene to an audience inclusive of fellow students and assessors. 

Damien and his team are not the only ones in the Department of Accounting to adopt this form of assessment. In fact, other CEs teaching Auditing and Assurance including Ashna Prasad and Lisa Powell have also collaborated and shared knowledge to refine this form of assessment and make it work for their own cohorts. The three CEs were motivated to implement storyboard and role-play in an auditing course to develop students on creative thinking and effective communication skills. These are highly desirable attributes of auditors, and will enhance graduates' employability.

I have also had a chance to provide some feedback on the marking rubric for this assessment task and saw tremendous value added to students' learning experience. So last month, Kris Nagy and I paid a visit to one of Damien's role-play sessions. Without further ado, here are some of the highlights. Enjoy!

Students during their performances

Two assessors discussing their results

A closing thought

Finally, I'd like to leave you with an inspirational message. The future of education is you, and you have the power to change how students learn and develop.  

References

1. Svinicki, Marilla. (2005). Authentic assessment: Testing in reality. New Directions for Teaching and Learning. 2004. 23 - 29. 10.1002/tl.167.

2. Battelle for Kids. (n.d.). Retrieved November 12, 2019, from http://www.battelleforkids.org/networks/p21/frameworks-resources

3. Frey, B. B., Schmitt, V. L., & Allen, J. P. (2012). Defining authentic classroom assessment. Practical assessment, research & evaluation, 17(2).

4. Designing Authentic Assessments. (n.d.). Retrieved November 1, 2019, from http://www.queensu.ca/teachingandlearning/modules/assessments/20_s2_12_designing_authentic_assessments.html 

Open up the classroom - A class on the Lawn

BTB3221 - Taxation law and practice is a unit that many students (especially those with international background) find difficult to study. As it is a specialist technical discipline. Our colleague Toan Le tried to make tax law easier to learn for students by introducing group learning workshop and presentations.  But in Semester 1 2018, he was allocated a seminar room that was not suitable to conduct the 3-hour long group learning workshop. The room had no window or no screen on the wall. And it was in a long rectangle shape which made it difficult for the students at the back to see the front.

We had to improvise - with the help of Deb McCormack and Tristan Cui from the TaLT, we moved the students out of the traditional classroom and we facilitated the outdoor on the lawn of the Peninsula campus.

Each week, after the 90 minutes lecturers, Toan took the 38 students out to the lawn in front of the Peninsula library and ran a 90 minutes workshop there.

How it works is that like in the traditional classroom students were broken up into groups and allocated a space to work and then to present their group work. As the students did their work Toan would facilitate their learning by going around each group and joining in the discussion, assisting them to answer their allocated tasks.

To communicate with the larger group and deal with the occasional noise, Toan carried a portable microphone that the TaLT supplied.

Feedback /outcome

The workshops proved to be successful. Students enjoyed the different learning setting! Happy students generally correlated to a better learning experience!

Perhaps because they were being outdoor and have an open space to work, students showed better engagement than when they were learning in the classroom. They did not check their mobiles or access Facebook or Twitter on laptops and they were even taking selfies for the special classes.

When it was time to present, the students listened inattentively as the picture shown. The noise was not a problem. Thanks to the portable microphone I was heard and the student presenters did not experience any issue. In fact, students overcame it by moving closer in to listen.

However, you need to consider the students with health issues for this setting. Also, the cold weather stopped us from doing that for the whole semester.

Overall, it was a successful experiment of a flexible and new approach to teaching and learning. And it is FUN!

New Features: Images, Code, Maths in Monash FLUX

New Features: Images, Code, Maths and More!

Our Monash polling system FLUX has just added some new and useful features: it is now possible to add images, code and LaTeX to Polls in FLUX!

Images in Polls

It's now possible to add images to Multiple-Choice Polls by dragging and dropping your image into the question textbox (see below).

Code in Polls

You can now write code in Multiple-Choice Polls either `in-line like this` or ```in blocks like this``` (see below).

Maths (LaTeX) in Polls

It's also now possible to render a limited subset of LaTeX in Multiple-Choice Polls by typing equations like this: $$ \sqrt(4) = 1 + 1 $$ (see below).



If you are excited about the new features like me, why don't you login FLUX now and give it a try? If you have any further questions, please contact us or you can find answers in this support document.

What's going on at STARLab?

I visited Caulfield's STARLab (Simulated Teaching and Research Laboratories) to observe the BFX5260 Treasury and Financial Markets teaching team in action, and I was in for a treat. The morning started out with great energy. Students were lining up to get their ID card scanned for attendance, and looking eager to get started. 

This semester, the BFX5260 teaching team have implemented co-teaching, the flipped-class model, trading simulation, and digital in-class assessment all at once. How do they do it? Let’s dive in. 

Co-teaching

Wayne Huf, Amale Scally, Simon Yap, Long Pham and Linh Nguyen make a great teaching team. They did a fantastic job collaborating to facilitate two classrooms simultaneously. One of the goals was to keep the two classes going at the same pace, and timing of in-class assessments to be in sync. 

In order to achieve that, responsibilities are shared among the teaching team. Everyone takes turn to instruct, facilitate activities and provide technical support to students every week.  

The co-teaching model got everyone in the team on their feet, and actively attending to every group in the class. It was great to see how much attention and support students received throughout the session. 

Flipped-classroom model

The concept of a flipped-classroom model has been around for some time, and has earned its place in the current landscape of higher education. Exploration and familiarisation with the new weekly topic happens prior to class time, and that's what has been implemented in BFX5260.

'Pre-load' materials including short videos, reading and exercise files have been provided for students to engage in independent learning every week. Moodle resources were referenced frequently during the session, which was a fantastic way to reemphasise the significance of the Moodle site as a one-stop-shop to assist students with their study. Workshop times are dedicated to hands-on activities and peer-learning where students exchange ideas and consolidate new knowledge. What's more, is that students are incentivised to complete pre-class work by a weekly test at the beginning of class. Even though questions are randomised, students were allowed to discuss and work collaboratively through this assessment.

An important note to take here is that the link between pre-class and in-class work has been well illustrated. Without having done their work prior to coming to the session, students' learning experience would not have received the same benefits and impact.

Excel classes were offered to students to help them
become more confident with using the software

Trading simulations

Throughout the session, students went through a range of simulated trading scenarios. Pre-programmed prompts were scheduled during some of the activities to increase interactiveness and sophistication of the exercise. This was a fantastic illustration of how complex and fast-paced a real trading environment could be.

The design of these workshops has thoughtfully taken into account valuable opportunities for students to apply what they have learned, and go from knowing to doing. What's more, is that students go to practice making decisions promptly and effectively, to respond to the dynamic nature of their future employment context.

To guide students through these simulations, procedural knowledge was demonstrated on Excel by the facilitator, followed by time for repetition on students' computer.

Students working on their Excel sheet

Learning is then solidified by peer learning. The trading simulations happened as individual exercises as well as group activities. Conversations were buzzing among students in the room to discuss the process and results of their practice. 

Students discussed during the exercises

By closely watching and assisting students while the simulations occurred, the facilitator was able to recognise and showcase outstanding work from individual student for the whole class. The students were also rewarded with very encouraging comments from the instructor and their peers, adding even more energy to the atmosphere. 

In-class assessment

In-class assessment was conducted at the end to solidify everything new students have learned throughout the session. To ensure the integrity and authenticity of students' attempt during the assessment, a software called AB Tutor was run in the control room. Excel files containing students' work were pulled from their Monash computer and deleted once the transfer has been completed.

The control room - where the "magic" happens

The vision

The learning activities in STARLab do not only provide an opportunity for students to gain simulated trading experience, but also expose students to ethic considerations, encourage them to be professional and understand the value of their human inputs behind machines. Click the video below to hear from the teaching team and a unit alumnus themselves. 

A closing thought

It was inspiring to see the amount of thought and effort that went into designing and delivering the unit. Perhaps it took trial-and-error to continuously improving their teaching practice, but the team have been rewarded with the level of participation and engagement among students.

We look forward to observing more active learning strategies in your classroom.

Become an effective workshop facilitator

This month, the Department of Econometrics and Business Statistics (EBS) welcomed Paul White, the Associate Dean Education at the Faculty of Pharmacy and Pharmaceutical Sciences at their departmental welcome for new teaching associates. Paul ran a fantastic session on workshop facilitation and active learning for our colleagues at EBS, and we hope you will enjoy reading about some of the highlights from this session.

Paul and a group of participants

Whether you are a seasoned educator, or new to teaching, facilitating a workshop effectively can be a challenging task. The active dynamic and demanding nature of a workshop may mean that the facilitator needs to acquire many skill sets to engage and guide students. Throughout the training session at EBS, the whole group had a great dialogue and took home great insights into effective practices. We saw small and large-group discussion, mini role-play activity and many opportunities for colleagues to reflect.

Role-play activity to re-enact different student behaviours

Key takeaways

Here are a few key takeaways on how to effectively run workshops. We hope this can be your food-for-thought:

1. Establish a culture of effective learning

As the facilitator, you have the opportunity to lead by example. By modelling being well prepared, you will have a great chance of establishing a good culture of effective learning among your students. Planning and preparation is the key to facilitating a workshop effectively, and it is also the key to successfully participating in and contributing to a workshop.

2. Use the Socratic method

Depending on your disciplines, the facilitator may have the ‘right’ answers to questions most of the time. However, such questions often address the lower order thinking skills such as recalling information, understanding basic concepts or applying concepts to simple examples. On the other hand, the Socratic method of asking thoughtful guiding questions to stimulate discussion among students, without giving them one absolute answer, is the best way to help students develop higher order thinking skills such as evaluating and critical thinking.

3. Know the key characteristics of an effective facilitator

• Exercising good body language, patience and empathy, and showing enthusiasm from the facilitator, just to name a few, are great characteristics that a facilitator could have. How do you achieve these? Unsurprisingly, practice makes progress.
• Involving all participants. Try ‘tracking your heat-map’, i.e. how you move around in the room and address each group of participants. It is also advisable to keep some distance and not to be too intimidating to students.
• Communicating with a personal touch. For example, a great idea a participant shared was to get in touch with students prior to the semester and connect with them personally during the first session. This got students to keep coming to the following sessions. It is also good to get to know students on a first name/ preferred name basis.

4. Build and maintain a positive students’ perception of you

A facilitator’s energy can be contagious, and students can be influenced by how you carry yourself throughout your workshop. Enthusiasm and attentiveness can help facilitators go a long way in making and keeping a good impression to students.

5. Gather feedback from students

No teacher is perfect, and there is always room for improvement and enhancement in your facilitation practice. Gathering quick formative feedback from students, whether by verbal or written mean, may help you uncover great potential for your practice.

A closing thought

Throughout the session, our colleagues at EBS were very enthusiastic in sharing about their own teaching and facilitating experiences, and it was rewarding to hear the buzz from many great conversations about the ‘dos’ and ‘don’ts’ in running a workshop. We look forward to having more inter-faculty collaborations like this, in which we share knowledge, learn from each other and feel inspired to try new things.

Group discussion

Yee Haa, it's SXSW EDU in Austin Texas

What is SXSW

“Founded in 1987 in Austin, Texas, SXSW is best known for its conference and festivals that celebrate the convergence of the interactive, film, and music industries. An essential destination for global professionals, the event features sessions, showcases, screenings, exhibitions, and a variety of networking opportunities. SXSW proves that the most unexpected discoveries happen when diverse topics and people come together.”

“SXSW EDU is a component of the South by Southwest® (SXSW®) family of conferences and festivals. Internationally recognized as the convergence gathering for creative professionals, SXSW EDU extends SXSW’s support for the art of engagement to include society’s true rock stars: educators!”

https://www.sxswedu.com/about/

Stats

SXSW
Attendees (2018) - 75,098
Conference sessions - 2,147

https://www.sxsw.com/facts-figures-quotes/

SXSW Edu
Registrants (2018) - 8,132
Conference sessions - 449

https://www.sxswedu.com/about/

The Sessions

The majority of conference programming is created by “PanelPicker®, a two-part, online process that enables the community to lend their voice to the event. Step one encourages the community to enter a session proposal to speak at SXSW EDU 2019. Step two allows the community to browse all of the ideas, leave comments, and vote for their favorite proposals.”

This year the topics that featured heavily at SxSW and SxSW.edu reflected those being discussed in the wider community - AI and the future of work, and micro-credentialing. In this report I provide an overview of some standout sessions.

Edcamp

Some of you may have heard of or attended ‘un-conferences’, where the topics of discussion are more fluid and based on what individuals and groups want to talk and hear about. EdCamp is a type of ‘un-conference’ for educators that started in the USA in 2010 and had now spread around the world. The basic premise is that attendees come with topics they want to talk about and the topics are sorted into ‘discussion sessions’. There is a lot of information on their site including a link to an Edcamp Organizer Handbook. If anyone would like to organise an Edcamp or would like to participate in one let us know.

Non-obvious

Trend curator, storyteller, innovator Rohit Bhargava presented a fascinating overview of his 2018 non-obvious trends. Rohit first published the Non-Obvious Trend Report in 2011 and it has now evolved into best selling book Non Obvious (How to predict trends and win the future) which is updated annually. Some of the ideas Rohit discussed in more detail included:

• RetroTrust which is the “idea that we trust in brands and experiences from our past” - the trend is thought to be a reaction to fake news. 
• Muddled Masculinity describes the “rising empowerment of women and reevaluation of gender itself are causing widespread confusion and angst about what it means to be a man today.”

Learning Sciences and Ed Tech: Uncovering the Facts

Alexandra Resch - Bill and Melinda Gates Foundation
Jeremy Roschelle - Digital Promise Global
Katrina Stevens - Chan Zuckerberg Initiative
Melina Uncapher - Institute for Applied Neuroscience

The question posed to the panel was ‘What is the ONE learning science fact you wish all educators (especially those who integrate technology into their teaching) knew, and why?’

The panel used a neuro-scientific lens to look at some common learning challenges. Of particular interest was the idea presented by Katrina Stevens who spoke about ‘Identifying and impacting motivational issues’. Katrina emphasised the need to interpret student responses to learning challenges. The discussion focussed on a framework developed by Richard Clark and Bror Saxberg1 that posited consideration of the whole learner perspective gives insight into motivation issues.

1.Engineering Motivation Using the Belief-Expectancy-Control Framework || Interdisciplinary Education and Psychology || Rivera Publications. (2019). Riverapublications.com. Retrieved 1 April 2019, from http://riverapublications.com/article/engineering-motivation-using-the-belief-expectancy-control-framework#article-info

https://doi.org/10.31532/InterdiscipEducPsychol.2.1.004 

Algorithms go to Law School: The Ethics of AI

Tess Poser - AI4ALL
Francesca Rossi - Global Leader for AI Ethics, IBM (Member of EU High-Level Expert Group on Artificial Intelligence)
Lynne Parker - Assistant Director for AI, White House Office of Science and Technology Policy
Lucilla Sioli - Director of AI and Digital Industry, European Commission

In this standout session four amazing women provided a high level overview of some of the programs and guidelines being developed by governments and the EU to address some of the future challenges of AI.  

• Guidelines 
• Partnership of AI
• Everyday ethics for AI designers
• euinaustin.org/

SXSW is huge, busy, crazy, overwhelming, inspiring, exciting and very tiring! I hope to see y'all there next year!