This article answers the following questions about quiz editing:
- Is it possible to edit Waymaker quizzes?
- Who is responsible for making quiz edits?
- What happens if no quiz edits are made?
- How do I access the question banks?
- How are the question banks organized?
- How do the question banks work?
- Tips for deciding which edits to make
- How do I add, edit and delete questions?
- How do I delete an enabling outcome?
- What can’t I do (yet) with the quiz editing tool?
Is it possible to edit Waymaker quizzes?
Yes, it is possible to edit Waymaker quizzes, however at the moment editing is not enabled by default for every faculty member in a course. If you need to be able to edit a quiz and are unable to see the editing gear (see How do I access the question banks section below) please contact us on firstname.lastname@example.org to ensure we can set up editing for you.
Details about what you can edit and how you can edit them are different for math courses compared to other courses.
For all non-math Waymaker courses, you can:
- Add, edit and delete items on machine-graded assessments
- Delete learning outcomes on machine-graded assessments
- Delete entire machine-graded assessments
Waymaker math courses (Beginning Algebra, Intermediate Algebra, College Algebra, Math for Liberal Arts) are a little different. Waymaker math assessments use algorithmic problems delivered by Lumen OHM (Online Homework Manager)
The rest of this article describes quiz editing in non-math courses.
Who is responsible for making quiz edits?
At some institutions, one lead faculty member is responsible for editing the quiz banks that will be used by all course sections. Other institutions have chosen to require that faculty members to make their own quiz edits for the sections they teach. If you’re unsure about whether you are personally responsible for making quiz edits, please check with the person at your institution who coordinates work with Lumen Learning.
If faculty who are not responsible for making quiz edits identify an opportunity to improve a quiz or quiz question, they will need to coordinate with the lead faculty who is responsible for making such edits.
What happens if no quiz edits are made?
If no quiz edits are made, all the quizzes and assessment activities still work. Students will receive questions drawn from the complete Waymaker quiz banks, and they will be assessed on all learning outcomes. Assessment items will reflect the wording and response options provided by Lumen in the quiz banks.
How do I access the question banks?
You will access and edit the question banks for a particular module via the study plan for that module. There is a separate question bank for each assessment (Show What You Know pretest, formative Self-checks and graded quizzes) in each module.
To edit the graded module quiz, you will hover over the “Quiz Results” tile and click on the gear icon that appears in the upper right corner (see image below).
To edit the Show What You Know pretest, click on the gear icon that appears in the Show What You Know tile (see image below).
To edit Self-check questions, click on the gear icon that appears on each tile in the Dive In section (see “What Is Economics?” tile below). In the Dive In section, there is one Self-check per tile.
How are the question banks organized?
Just like the study plan organizes course content by learning outcome, question banks organize machine-graded assessment items by learning outcome.
Remember that on the study plan, each tile in the “Dive In” section represents a learning outcome.
In the question bank, the learning outcome with which each question is aligned is indicated on the grey bar at the top of each question, as shown in the image below. The names of the outcomes in the grey bars match the names of the tiles in the study plan.
Tip: Hover over the outcome name to see the actual learning outcome definition.
How do the question banks work?
Question banks are organized by learning outcome and then by sub-outcome. The banks generally contain 5+ questions per sub-outcome. When a student takes an assessment, she will see only 1-3 of those questions, depending on the assessment type.
For example, students typically receive 1 questions per sub-outcome on each graded module quiz (exception: some courses with fewer sub-outcomes contain 2 questions per sub-outcome). If a module contains 5 learning outcomes, and each learning outcome has 2 sub-outcomes, the study plan for that module will contain 5 tiles in the Dive In section, and the quiz will contain 10 questions.
The instructions at the top of each question bank provide additional details about how the question banks work:
Tips for deciding which edits to make
We recommend that you take the following steps before your students begin to take quizzes.
- Review the question bank for each graded module quiz.
- Review the learning outcomes. Make a note of any learning outcomes you don’t want to assess students on, so you can remove all questions associated with those LOs.
- Make notes on any items you’d like to edit or remove. For the remaining quiz items, look over the quiz wording and response options.
- Review all the questions associated with each learning outcome. If you would like to add any new questions, draft the question wording and response options for new items.
- Confirm the question content is covered in the course material associated with that learning outcome because if students answer the question incorrectly, they will receive feedback encouraging them to review that content.
Tip: You may want to do the same for the Show What You Know pretest and formative Self-Checks.
If students find and report problems with machine-graded assessment items, remember that these are opportunities to dialog with students and create teaching moments. Evaluate the question and, if desired, edit the question to resolve the issue.
We recommend keeping a record on your local computer of the new questions that you create by adding or editing questions. That way, you can easily:
- Share your edited questions with colleagues (remember to put an open license on them so that others may use them!)
- Recover edits in case your internet connection drops while you are editing a quiz but before you save changes
How do I add, edit and delete questions?
The general process for adding, editing and deleting question is:
- Add, edit, or delete a question (explained below).
- Continue adding, editing, or deleting other questions.
- When all changes have been made, click “Save Assessment” at the very top or very bottom of the bank.
Your changes will take effect only after you click “Save Assessment.”
Adding a question
To add a question, click the “Add Question” button at the very top or very bottom of the question bank.
A new, blank question will appear. You will need to select the outcome and sub-outcome to which the question is aligned, enter question text and answer options, and indicate the correct answer.
Don’t forget to make sure that the question content is covered in the study plan tile for that outcome. If students answer the question incorrectly, they will receive feedback encouraging them to review the study plan tile associated with the outcome that appears in the drop-down menu at the top of the new question.
When you are finished, click “Done Editing” in the upper right corner to let the system know that the question appears the way you want it to appear to students.
You may also duplicate and then edit an existing question. This can be useful if you want to add a question that is similar to an existing question. Just click the duplicate icon on the right side of the grey bar (see image below).
In this case, a duplicate question will appear in draft mode, and you may edit it as described under “Editing a question.”
Editing a question
To edit a question, click the pencil icon on the right side of the grey bar at the top of the question (see below).
You will then be able to edit the question in draft mode. You may modify question text, the answer options, and which answer is correct. When you finish editing, press “Done Editing” in the upper right corner to let the system know that the question appears the way you want it to appear to students. If you want to cancel your edits, click the “x” icon that appears where the pencil icon used to be.
When you edit, pay attention to whether your edited question assesses the same outcome and sub-outcome that the original question assessed. If it assesses a different outcome or sub-outcome, make sure to use the appropriate drop down menus to select the outcome and sub-outcome to which your edited question is aligned. Also, make sure that the question content is covered in the study plan tile for that outcome. If students answer the question incorrectly, they will receive feedback encouraging them to review the study plan tile associated with the outcome that appears in the drop-down menu at the top of the new question.
Deleting a question
To delete a question, click the trashcan icon on the right side of the grey bar at the top of the question.
A pop-up message will confirm that you intend to delete the question before the question is removed.
For each outcome included on an assessment, there must be a minimum number of questions aligned to the outcome in the question bank. The minimum number of questions varies by assessment and is indicated at the top of each bank under “How This Question Bank Works.”
If you fall below the minimum number of required questions, you will receive a warning message.
How do I delete an enabling outcome?
Deleting an enabling outcome on an assessment
To delete an enabling outcome, delete all questions associated with that outcome. A warning message will appear at the top of the bank confirming that the outcome will be deleted when you press “Save Assessment.”
When you click “Save Assessment,” a pop-up message will ask for confirmation that you intend to delete the outcome. If you did not intend to delete the outcome, you should press “Cancel” and add the specified number of questions aligned to the outcome.
Tip: Currently, deleting an enabling outcome from the Quiz will NOT automatically delete the corresponding content tile from the Study Plan. We recommend telling students that the tile is not required and that they will not be tested on it on the quiz.
Tip: Currently, deleting an enabling outcome from the Quiz will NOT automatically delete that enabling outcome from the Show What You Know pretest. You may access the Show What You Know pretest question bank and delete it there if desired.
Remember: After you have finished making changes, click “Save Assessment.”
What can't I do (yet) with the quiz editing tool?
Easy image uploading
It is possible to create questions with images. Currently, however, this may be done in the html view only in the question editor. You will need a URL where the image is housed, and don’t forget to author alt text for accessibility. We are working on a more user-friendly way to upload images and author alt text.
When you edit questions, you have the opportunity to author feedback specific to each answer option. This is a step towards providing the ability to show students more detailed feedback when they select incorrect answers on machine-graded assessment items. This can be especially powerful when distractors are written to represent common student misconceptions. In the question editing mode, you will see fields where you are able to author feedback. Any feedback you author will be captured in the system. We do not yet have the ability to show that feedback to students on quizzes, but that feature is coming.
Re-scoring quiz attempts after correcting a question
After you edit a quiz question, all students who receive that question on a quiz attempt will be scored based on the edits you have made. If any student received the non-edited version of the question before the edit was made, you will need to adjust the student’s score manually in your Learning Management System grade book. Currently, it is not possible to automatically rescore the attempt in Waymaker.