Organise content
Prepare activities
Provide support
Arrange assessment
Computer-marked quizzes
Computer marked quizzes provide options for objective testing using a database of questions developed by the teacher and marked by the computer.
Samples
Quiz related to training packages
Created using Quiz Faber, this quiz tests your knowledge of Training Packages
| Source | Introducing Staff to the Australian Quality Training Framework (AQTF) - a games-based approach |
|---|---|
| URL | http://www.flexiblelearning.net.au/egames/resources/index.html |
| Use | VET staff |
| Delivery | Relatively easy to construct and deliver. Requires a copy of Quiz Faber and a website to host the completed quiz. Can be loaded into a Learning Management System such as WebCT or Blackboard. Note that this site was developed in 2003 and is based on a superseded version of the AQTF. |
| Customisation | |
| Availability | NA |
Quiz on sexuality
Quiz to test underpinning knowledge
| Source | Where's the party at? - Toolbox , Lead agent Swinburne TAFE |
|---|---|
| URL | http://www.flexiblelearning.net.au/toolbox/demosites/series5/519/site/sex-sex-01_sexfaqs.htm |
| Use | literacy and numeracy for 15-19 year olds |
| Delivery | Can be delivered using a CD or loaded into a Learning Management System such as WebCT or Blackboard. |
| Customisation | The material in this Toolbox has been developed to allow for customisation.However this activity is not easily customised as it has been developed in FLASH and the original master file is not available in this context. |
| Availability | Details of how to purchase this Toolbox are available on the Flexible Learning Toolbox site |
Back to top
Why include computer marked quizzes?
There are a number of reasons why you may choose to use computer marked quizzes in your delivery:
- pre-course diagnostic testing to determine learners' prior knowledge
- self-assessment for learners to check their progress through a topic
- formative assessment which assists learning through feedback
- summative assessment to test learners' mastery of the content.
- provide feedback on teaching strategies
- provide multiple opportunities for learners to practice understanding
- identify areas of learner misunderstanding
- engage learners with content and maintain their interest levels
Some other benefits are:
- potential time saving for teachers after the initial development time
- the ability to monitor the progress of learners through more frequent assessments
- enhance learning through the inclusion of graphics and multimedia
- the abilty to generate diagnostic reports in Learning Management Systems (LMS) such as WebCT and Blackboard
- automatic integration of results which can be entered into administration systems
- automatic feedback given to learners during and after a quiz.
Features
Computer marked quizzes can include a number of different question types:
- multiple choice questions (MCQs) which allow the learner to choose from a list of possible answers.
- special types of multiple choice questions such as True/False and Yes/No questions.
- multiple response questions (MRQs) which involve the selection of more than one answer from a list.
- text/numerical questions which involve entering text or numbers.
Integrating computer marked quizzes
Design steps for developing quizzes for Learning Management Systems
- Write questions either in a text document or directly into a software package (eg Respondus)
The more subjective the answer to the question is, the more judgement needs to be used by the Learner in deciding if the answer to the question is correct - on-line quizzes marked by the computer will need to be objective. - Develop feedback statements for the Learner for correct and incorrect answers. Providing Feedback on why an answer is wrong enables additional learning opportunities to enable the Learner to retake the question with an informed answer.
- Upload to questions into the database of a Learning Management System
- Create quizzes by selecting individual questions from the database
- Assign settings to quizzes
- scores and weightings for questions
- number of questions shown at any time
- time allowed for completion of each question
- number of attempts allowed
- dates for release
- feedback options
The following suggestions for drafting quiz questions come from Online collaborative learning - Issues in on-line delivery: Quizzes and discussion groups :
When writing Short Answer Questions:
- avoid lengthy questions, make them as simple and direct as possible
- make sure that there is a definite correct answer
- be precise
When writing Multiple Choice Questions
- present a simple well-defined problem in the question
- ensure that the alternative answers all relate to the question in some way
- include as much as possible of the item in the question
- make the question as brief as possible
- consider using graphics to illustrate the question
- alternative answers should all be grammatically consistent with the question
- avoid mutually inclusive and mutually exclusive answers as much as possible
- vary the position of the correct answer (use the randomise answers tool if available)
When writing True/False Questions
- keep statements brief
- avoid partly true and partly false items
- avoid using two or more ideas in a question
- avoid words like ‘all’, ‘always’ or ‘never’ – this tends to give away the fact that this is the wrong answer
- avoid broad general statement
Assessment
Computer marked quizzes can be used for both summative and formative assessment. They would generally be used as part of a range of assessment strategies. A Trainer or another learner can mark quizzes within a computer system or Learner Management System on-line, or completed and lodged electronically but marked.
Technical notes
Learning Management Systems usually have a tool for constructing quizzes and question banks. They also have various strategies for the delivery of these quizzes to learners.There are other software products which have the ability to integrate with Learner Management Systems to simplify the development of questions.
Skills
There are a number of skills which you will need to have to deliver quizzes online:
- the ability to write valid questions
- the ability to use quiz creation software
- the ability to load and manage the quizzes and databases in an online environment
- the ability to monitor quiz completion.
See also
From the Framework
More resources from the Australian Flexible Learning Framework
- ARED (Applications for Rapid E-learning Development)
ARED is a free tool to help Trainers quickly create interactive activities (including multiple choice, true and false quiz questions) for online learning and combine these activities into a learning sequence. These activities can then be integrated into a blended learning delivery approach or a learning management system.
http://www.flexiblelearning.net.au/flx/go/home/projects/2006/newpractices2006/pid/369 ARED can be ordered from http://www.flexiblelearning.net.au/flx/go/home/projects/2006/newpractices2006/pid/200 - Assessment Generator
Tool that enables Trainers to develop a variety of assessment tools including quizzes. Log In, click on Assessment Tools and begin to build your tool by selecting Create an Assessment Tool. You can choose the tool type (multiple choice etc) from a pull down menu.
http://generator.flexiblelearning.net.au/ - Yola – Your online personal assistant
A learning assistant that complements existing and new online resources and deliver related or support content depending on how the user interacted with the original resource. YOLA can be applied to other learning resources and the numeracy learning objects can be used either within YOLA or on their own.
YOLA can serve any other learning content it is given so it could provide support in other subject areas. You can view a sample use of Yola for the Building and Construction Toolbox by following the link below.
http://pre2005.flexiblelearning.net.au/projects/resources/yola_bc/default.htm (view a demonstration quiz - click on Next then Preparing the Surface then Underlays then take the sample quiz under “Length”. - QTI – m – Player: Mobile Assessment
The Institute of TAFE Tasmania completed a series of practical trials in the use of the QTI m-Player™ for workplace assessment. Individual learning practitioners/assessors were then given the opportunity to evaluate and comment on the usefulness and practicality of the player for field assessment that is tied to a particular context.
http://qti.flexiblelearning.net.au/tafetas.html - Skills Assessment for Computer Based Learning
Skills Assessment is a fun and interactive product that allows learners to self-assess the basic skills they need to successfully study online or to use computer-based technologies.
http://pre2005.flexiblelearning.net.au/products/skills.htm - Leaders: Ron Pearce: Queensland State Presentation
The presentation discusses the history, advantages and disadvantages of online assessment systems including computer marked quizzes. The presentation also includes an overview of software that can be used for online assessment purposes.
http://www.flexiblelearning.net.au/leaders/fll_demo/events/pastevents/2002/statepres02/r_pearce.ppt
Tools and resources
- Guidelines for Designing Knowledge Based Tests
This guide has been produced by VETASSESS and provides practical advice for assessors, working with training packages, on the design of knowledge based tests.
http://www2.assessit.net/webpage/content/1_resources.cfm - Respondus
Respondus is a software tool for creating and managing quizzes that can be printed to paper or published directly to Blackboard, WebCT and other eLearning systems.
http://www.respondus.com/ - How to create a Quiz in Moodle
Creating Quizzes in Learner Management Systems can be difficult at first. Try this Step-by-Step guide to setting up a variety of quiz types in Moodle Learner Management System.
http://download.moodle.org/docs/using_moodle/ch5_quizzes.pdf - How to create a Test in Janison
Creating Quizzes in Learner Management Systems can be difficult at first. Try this Step-by-Step guide to setting up a variety of quiz types in Janison Learner Management System.
http://www.janison.com.au/janison/support/Tutorial.asp?Tutorialid=117 - Effective Quiz Practises
Some useful ideas about designing effective quizzes for learners.
http://docs.moodle.org/en/Effective_quiz_practices - Quiz-Faber
A tool to create and integrate various computer marked quiz types; T/F, multiple-choice, cloze, matching, gap filling. It is capable of generating a report for each learner, with a total score and summary for each question.
http://www.lucagalli.net/
This tutorial allows you to use a Macromedia Flash MX quiz template to create a movie with the following six interaction types: - Using a Macromedia Flash MX quiz template
This tutorial allows you to use a Macromedia Flash MX quiz template to create a movie with the following six interaction types: True or False, Fill in the Blank, Multiple Choice, Drag and Drop, Hot Object and Hot Spot. These flash quizzes can then be embedded in webpages or a Learner Management System.
http://www.adobe.com/support/flash/applications/quiz_tutorial/
