Tests & Quizzes

From e-Learning Documentation

Revision as of 13:52, 9 November 2010

Last updated: 11-09-2010

Overview

There are two online testing tools in Sakai, Assessments and Tests & Quizzes. You may choose whichever of these tools best meets your needs. In general, Tests & Quizzes offers more function than Assessments, but many people find the Assessments tool more intuitive and easier to use. Go here to view a chart outlining which tool works best for various assessment tasks.

The two tools are very different in their approach to online testing.

Assessments REQUIRES the use of Question Pools and those Question Pools MUST be structured in a specific way. Question Pools must contain questions of the same point value and difficulty level. This is a good practice and a helpful way to set up your Question Pools, resulting in a very nicely organized collection of Question Pools. Assessments also has an easy process for assigning an assessment to special needs students that need added time, but there is no option to assign an assessment to a group.

Assessments also offers the option to require students to acknowledge the Honor Pledge before they can submit the assessment. Certain question types, Multiple Choice, True/False, and Essay, can be imported into Assessment from Respondus. Question Pools can be imported from Tests & Quizzes into Assessments.

Probably the biggest limitation of Assessments is that once an assessment has been accessed, even by a Test Drive, that Assessment cannot be edited or deleted. It can only be archived.

Tests & Quizzes offers Question Pools, but does not require their use. You may enter questions directly into an assessment without those questions being assigned to a Question Pool. You can have questions of varied difficulty levels and point values in one Question Pool. You can create Sub-Pools within Question Pools to further aid organization. Question Pools in Tests & Quizzes are associated with the creator's Username, not the course in which the pools were created. So if you are instructor for ABC1234 and CBA4321 and you create five Question Pools in ABC1234, you will also see those five pools when you go to your CBA4321 course. This is helpful in that you always have access to your Question Pools, but it requires you to pay attention to naming conventions. You would not want to name a Question Pool "Exam 1."

Tests & Quizzes offers the added security of limiting an assessment to a specific IP address, or group of IP addresses. You have the ability to show students the statistics on an assessment and individual questions within the assessment. Questions can only be entered manually, or by cutting and pasting a properly formatted text document. An assessment in Tests & Quizzes can be assigned to a group. You can edit many aspects of a published assessment, including the ability to edit a question and regrade the assessment.

Create and Manage Question Pools in Tests & Quizzes

As you use the Tests & Quizzes tool, you will be creating questions that can be used over and over in other exams in the future. You will want to organize your questions into Question Pools so that you can easily locate the questions you want to use in the future.

Once you have Question Pools, you can create an assessment that will randomly draw from one or more pools. For example, you might create two pools called "Chapter 1 Easy" and "Chapter 1 Difficult" that each contain 25 questions. You can set up an assessment that randomly pulls 5 questions from each of those pools so that all your students get 10 questions - five easy and five difficult - but they could each have an entirely different assessment. If you use this option, your question pool is actually copied into the assessment created. If you change the question in the pool, it will not affect the assessment.

NOTE:Question Pools are associated with your username, not the course in which they are created. So if you create a Question Pool in course ABC1234, and you also teach CBA4321, you will see your Question Pools in both locations and they are available to use in both locations. Because of this, you will want to name your Question Pools in a way that clearly identifies the questions. This also means that you are the only one that can see your Question Pools. If you have a TA or another instructor that needs access to a Question Pool, you must "share" that pool with that person. He/she then has the ability to copy it into his or her own pool.

Create a Question Pool in Tests & Quizzes

Within Tests & Quizzes:

1. Click Question Pools at the top of the page.
2. Click Add New Pool
3. Pool Name* - Type a name for the pool
   • "ABC1234 Textbook" is a name that would identify the source of these questions when you see this pool in other courses you teach.
4. Fill in any other content that could be helpful to you in the future.
5. Click Save

Import a Question Pool in Tests & Quizzes

You will see the option to Import a Question Pool. This option is not functional at this time. Do not attempt to import a Question Pool because it can corrupt your username, making it impossible for you to use the Tests & Quizzes tool at all. While this can be fixed, it takes a significant period of time to accomplish.

Add Questions to a Question Pool in Tests & Quizzes

NOTE: If you want to use images or link to other type of files in Resources such as audio or video files, you can insert a link to these files using the Content Editor, but the links will break when the content is imported into future semesters. To avoid this problem, add the file as an attachment to the question. This method will import with no problems from one semester to the next.

Within Tests & Quizzes:

1. Click Question Pools at the top of the page.
2. Click the hyperlinked name of the Question Pool to which you want to add questions.
3. A screen opens that shows all the Question Pool information, as well as how many subpools and questions are in the Question Pool. Beside the heading "Question" click Add at the right margin.
4. Select a question type from the "select a question type" drop-down menu.
   • See Question Types tutorial for an explanation of the various types of questions.
5. Click Save
6. Fill out the question information and click Save

Create a Subpool in Tests & Quizzes

Subpools offer another level of organization. If you create a pool called "ABC1234 Textbook," you might create subpools called "Chapter 1," "Chapter 2," etc. In those subpools, you could create more subpools called "Easy," and "Difficult."

Once you create subpools, you will see them listed when you click the hyperlinked name of the Question Pool. You may click the hyperlinked name of the subpools to add questions to subpools.

Within Tests & Quizzes:

1. Click Question Pools at the top of the page.
2. Click the hyperlinked name of the Question Pool to which you want to add a subpool.
3. A screen opens that shows all the Question Pool information, as well as how many subpools and questions are in the Question Pool. Beside the heading "Subpools" click Add at the right margin.
4. Pool Name* - Type a name for the pool
5. Fill in any other content that could be helpful to you in the future.
6. Click Save

Remove, Copy and Move Questions Within Question Pools in Tests & Quizzes

You may remove questions from a pool, copy them into another pool, or move them to another pool. Perhaps you create a Question Pool called "ABC1234 Textbook" in which you gather 200 questions. You decide you would like to organize these questions by chapter and difficulty level. You make subpools called "Chapter 1," "Chapter 2," etc. You may copy the questions into the appropriate subpools, which will mean that the questions are now in both the ABC1234 pool and the subpool. You may move the questions into the subpools, which means that the questions are removed from ABC1234 and are now only in the subpool. If you remove the questions, they are permanently deleted from that pool.

Within Tests & Quizzes:

1. Click Question Pools at the top of the page.
2. Click the hyperlinked name of the Question Pool that contains the questions you want to Remove, Copy or Move.
3. A screen opens that shows all the Question Pool information and lists all questions in that pool. Check the box beside the question(s) you want to Remove, Copy or Move.
4. Click Remove, Copy, or Move at the top of the list.
   • These links will not be live until you select at least one question.
   1. Remove - You will get a "Remove Question Confirmation" screen that asks if you are sure you want to remove the question(s). The question text will be listed so that you can be sure this is the question you want to remove. Click Remove.
   2. Copy - You will see a list of all available Question Pools into which you may copy the question(s). You can expand the Question Pools to find available subpools by clicking the triangle beside the pool name. Check the box beside the pool where you want to copy the question(s) and click Copy.
   3. Move - You will see a list of all available Question Pools into which you may move the question(s). You can expand the Question Pools to find available subpools by clicking the triangle beside the pool name. Check the box beside the pool where you want to copy the question(s) and click Move.

Share Question Pools with Other Instructor-Type Roles in Tests & Quizzes

Because Question Pools are associated with your username, not the course, if you want other Instructor-Type persons in your course to have access to them, you must "share" the question pool. Once shared, the pool can be copied to that person's pools and will then be available to that person in any course he/she teaches.

Share a Question Pool in Tests & Quizzes

1. Within Tests & Quizzes, click Question Pools at the top of the page
2. Beneath the pool or subpool you want to share, click share
3. A list of people is displayed that all have access to the pool. Unless you have already shared this pool, the list will include only yourself. Below that is a list of eligible Instructor types (Instructor, Designer, Facilitator, Teaching Assistant) to whom you may give access. Check the box beside every person with whom you want to share the pool.
4. Click Share

Revoke a Shared Question Pool in Tests & Quizzes

You may also remove someone's access to a shared pool. But realize that once you share a pool, the person may copy that pool and then it will be his or her own. In that case, he or she will still have access to those questions.

1. Within Tests & Quizzes, click Question Pools at the top of the page
2. Beneath the pool or subpool you want to share, click share
3. A list of people is displayed that all have access to the pool. Check the box under the "Revoke access" heading and click Share

Copy a Question Pool That Has Been Shared With You in Tests & Quizzes

Once someone shares a pool with you, you can build assessments utilizing the questions in this pool. You can also copy this pool so that the questions are yours. Before you can copy those questions, you must have a pool into which to copy the questions. You may add them to an already existing pool or create a new one. To copy a pool that someone has shared with you:

1. Within Tests & Quizzes, click Question Pools at the top of the page
2. You will see the pool that has been shared with you. In the column called "creator," you will see who created this pool and shared it with you. Click Copy underneath the name of the pool.
3. Your Question Pools will be listed. Check the box beside the pool into which you want the questions copied.
4. Click Copy

Question Types in Tests & Quizzes

All question types provide the Content Editor when you construct the question so that you can format the question, answer and feedback text, insert links, images, video, etc. There is also the option to add an attachment to the question.

All question types will allow you to provide feedback for each answer option as well as the entire question. You can provide different feedback based on whether the student answered the question correctly or incorrectly.

tutorials for each question type are included on the screen when you are creating the question.

There are nine different question types available in Tests & Quizzes:

Multiple Choice

There are three different types of Multiple Choice questions:

• Single Correct - there is only one acceptable answer.
  • With this option you can enable negative marking, which means that students would be penalized for giving the wrong answer. If you select this option, a box is opened for you to enter how many points are taken off the grade for a wrong answer.
  • You can also enable partial credit, which will allow you to give some credit for answers other than the correct one. If you choose this option, each answer box will have the option to enter a "% Value." An example would be:

In what city will you find the Yenikapi arhcheological site?

• Rome (0% correct)
• Constantinople (50% correct)
• Istanbul (100% correct)

Since the city was named Constantinople in the past, I will allow half credit for this answer.

• Multiple Correct, Single Selection - there are several options that are considered "correct" but students can only select one.
• Multiple Correct, Multiple Selection - there are several options that are considered "correct" and students may choose more than one.

NOTE: With Multiple Correct, Multiple Selection questions, students are penalized for choosing an incorrect answer. While students can lose credit for incorrect answers, they will not get less than zero for the question, even if they choose all the incorrect answers. There is no setting that will allow you to change it so that students do not lose points for incorrect answers. If you do not want students to lose points for incorrect answers, you will have to go to each instance of the question and give their points back. This is not exactly a "bug" since the tool does function as intended, but we will want to change the system at some point in the future so that the Instructor can change the setting.

Multiple Choice questions allow for the answers to be randomized each time the question is displayed to a student so that the correct answer is a different option each time. You can also require the students to provide a rationale for their answer so that you can verify that the student knows the answer and isn't just guessing.

Survey

This question type is primarily used for gathering information from participants in an anonymous survey. It is not possible to assign points for this type of question. There are several answer options, including Likert Scale options.

Short Answer/Essay

Short Answer/Essay questions provides students with a text box for typing their answers. The text box does not provide the Content Editor and has a limit of 4000 characters. If you need students to have the ability to format their text and enter more than 4000 characters, use the "File Upload" question type. This type question is not automatically graded. The instructor must view the student submission and enter a grade.

Fill in the Blank

Fill in the Blank questions ask the student to insert a word or words into the question text to complete a sentence or paragraph. While this question type is automatically graded, the student's entry must match exactly the option(s) provided by the instructor. There is some flexibility in providing acceptable answers, matching case, etc., but the best practice is to only use this type of question with totally unambiguous test questions.

Numeric Response

Numeric Response is essentially a Fill in the Blank type question that uses numbers for the answer instead of words.

Matching

Matching type question require that the student matches one term, phrase or image to another. For example, you could insert an image of a plant and the student would have to choose the name of the plant from a list provided. You must have exactly the same number of items on each list.

True False

True False questions ask the student to determine if a statement is true or false.

Audio Recording

This function is not currently working, but will allow students to record an audio answer to a question - especially good for language classes to test student's pronunciation and conversation skills.

File Upload

This question type asks the student to submit a file as his/her answer to the question. Of course, this question type must be graded manually. The File Upload type can be used in place of the Assignment tool, though the Assignment tool has many more options.

An example of one way to use this question type in an assessment might be that you attach a spreadsheet to the question text and ask students to fill it out and submit it as the question answer. You might also ask them to prepare a file prior to the test and attach it to this question during the test.

Assessment Types in Tests & Quizzes

Assessment Types are a set of pre-determined settings for your assessment. At UF, we have set up default Assessment Types using the most commonly used settings. All settings are editable so you have the ability to change any of them to meet your needs.

By default, you are offered a "Default Quiz" and a "Default Survey" Assessment Type. You also have the ability to create your own Assessment Type. You would only want to do this if you have unusual settings that you use consistently in assessments. Like a Question Pool, if you create an Assessment Type, it is associated with your username, not the course in which it was created. So if you create an Assessment Type in your ABC1234 course, you will also see that Assessment Type in your CBA4321 course. Unlike Question Pools, you cannot share an Assessment Type. If you have other Instructor-Types in your course that need to use your Assessment Type, they will have to create their own based on your settings.

Create an Assessment Type in Tests & Quizzes

If you decide you want to create a specific Assessment Type, you must consider all possible settings and how they affect the performance of your assessment. You also must decide what options will be editable once the assessment has been created. For example, if you set up an Assessment Type with specific settings that are uneditable, a TA or other Instructor, or even yourself, cannot change this setting in an assessment created from this Assessment Type. Many options will disappear altogether if you do not mark them as "editable." This would be helpful if you want to make sure that a specific setting is consistently maintained, but could also cause problems if there was ever a reason you needed to change that setting. If you make a setting not editable, that is permanent for any assessment built on that Assessment Type.

1. Within Tests & Quizzes, click Assessment Types at the top of the page.
2. Under the heading "Create a new assessment type" type a Title for the Assessment Type in the box and click Create
   • You are taken to a screen that lists the 13 categories for choosing your settings.
     • Assessment Type Information - this allows an instructor-type role working with the assessment based on this Assessment Type to view the title, author(s) and Description or Introduction to this Assessment Type. Students do not view this info.
     • Assessment Introduction - Your only option here is to decide if these things are editable in the assessment based on this Assessment Type. If you do not check the box, there will be no option to edit the Assessment Author(s) or the Assessment Description/Intro. Check the box next to the item(s) that you want to be editable.
     • Assessment Released to:
       • Anonymous Users - if you choose this option, you may send the assessment to users that are not enrolled in your course, or not even at the University of Florida. For example, you could create a survey that you want to send out to 15 colleagues in several institutions around the country. If you choose the "Anonymous Users" option, you may send the URL to the published survey to these colleagues and they can take the survey without logging in to e-Learning in Sakai. Of course, you will not be able to know the identities of those who took the survey.
       • Site Members - if you choose this option, the assessment goes to all student-type roles in your course.
       • Selected Groups - if you have created groups in your course, you may assign this assessment to a specific group or groups so that they see the assessment and the other students do not.
     • High Security - Your only option here is to decide if these things are editable in the assessment based on this Assessment Type. If you do not check at least one of the boxes, the High Security option will not be available in the assessment based on this Assessment Type.
       • Allow only specified IP Addresses - This option allows an instructor-type role to establish a range of IP addresses that can access the assessment. This is useful if you require the students to take the assessment in a proctored computer lab. If you enter the IP Addresses for that lab, a student using a laptop in the library, for example, cannot access the assessment.
       • Secondary ID and Password - This option allow an instructor to enter an ID and password that must be entered in order to access the assessment. An instructor using a proctored classroom could wait until all students are present and the door is closed before giving out the secondary ID and password.
     • Timed Assessment - Your only option here is to decide if this is editable in an assessment based on this Assessment Type. If you do not check this box, the Timed Assessment option will not be available in any assessment based on this Assessment Type.
     • Assessment Organization - three categories of options are listed here:
       • Navigation - Choose your option and decide if an instructor-type role can change it from whatever you choose as the default.
         • Linear access requires students to answer the questions in the order delivered with no going back to previous questions.
         • Random access allows students to answer the questions in any order and provides a Table of Contents so that students can navigate to various questions.
       • Question Layout - Choose your option and decide if an instructor-type role can edit it.
         • Each Question is on a separate Web page - each question has a "Save" button. This option provides the least chance of losing student work due to technical difficulties such as losing internet connection.
         • Each Part is on a separate Web page - You can create an assessment with one or several parts. For example, you could create a part with questions from Chapter 1 and another part with questions from Chapter 2. If you choose this option, each part has a "Save" button.
         • The complete Assessment is displayed on one Web page - there is only one "Save" button at the end of the assessment. This option runs the risk of losing data in the case of technical issues such as the loss of internet connection.
       • Numbering - Choose your option and decide if an instructor-type role can change whatever you set as default.
         • Continuous numbering between parts - you would use this option if you don't want to show the student that there are multiple parts.
         • Restart numbering for each part - this option makes it more obvious to the student that this is a separate part.
     • Mark for Review - this option is only useful if you have set navigation to random access. The "Mark for Review" feature is supposed to make it easier for students to revisit questions they have skipped before they submit their submission. In reality, it is minimally helpful. If you have allowed students random access to questions, the table of contents will always reveal which questions have not been answered yet. Choose whether or not to include this option and if it is editable in an assessment based on this Assessment Type.
     • Submissions - three categories of options are listed here.
       • Number of Submissions Allowed - Choose your options and decide if an instructor-type role can edit it. Do students get unlimited attempts (for example in the case of a practice quiz) or do they get a certain number of attempts? Select "Only" and enter the number of submissions in the box.
       • Late Handling - Choose your option and decide if an instructor-type role can edit it.
       • Automatic Submission - Choose whether or not to use this feature and whether it can be edited. This option is for assessments that are in progress at the time of the due date. It does not submit an assessment that was never begun.
         • If you chose to allow late submissions, choosing "Automatic Submission" has no effect. If you have an assessment with a time limit of 1 hour and a due date of Sept 12 at 3pm, if a student begins the test at 2:30pm, the student will receive the full hour because you have allowed late submission.
         • If you did not choose to allow late submissions, choosing the "Automatic Submission" option will submit any active assessments at the due date. In the scenario above, if the student logs in at 2:30, he/she will only get 30 minutes to take the assessment. Though the introduction page will show that the assessment time allowed is one hour, when the assessment actually begins, the timer will show 30 minutes. When there are five minutes left, a pop-up box will appear alerting the student that there are only five minutes left. When the time has expired, another box will pop-up that says that the time has expired and the assessment has been submitted.
     • Submission Message - If you check either or both of these boxes, this option will be available to you as you create the assessment.
       • Submission Message - this option provides the opportunity to create a custom message for the students that appears when they submit the assessment. Examples might be that you use this option to tell them when the grades will be released, or to direct them what to do once they've submitted.
       • Final Page URL allows you to create a link to web content - either a URL for a file in Resources or other website. When students submit their assessment the link will be available on the submission page.
     • Feedback - There are three categories of options under this heading.
       • Feedback Authoring - Choose which feedback options you want to be available as individual questions are created in the assessment and whether or not this can be edited.
         • Question-Level Feedback - This feedback would reference the question as a whole.
         • Selection-Level(A,B,C. . .) Feedback - This would allow the person creating the question to provide feedback for each answer option.
         • Both - Feedback options will be available for both the question as a whole and the individual answer options.
       • Feedback Delivery - Choose your option and if it will be editable in assessments based on this Assessment Type.
         • Immediate feedback - Students see the feedback as soon as they answer the question.
         • Feedback on Submission - Students see the feedback as soon as the assessment is submitted.
         • Feedback will be displayed to the student at a specific date - you determine when the feedback is displayed.
         • No feedback will be displayed to the student
       • Feedback Components Students Can See: - Choose your option(s) and if it will be editable in assessments based on this Assessment Type.
         • Student Response - Students see the answer they chose for this question.
         • Correct Response - Students see the correct answer to the question.
         • Student's Assessment Score - They see the total score for the assessment.
         • Student's Question Scores - They see the score for each individual question.
         • Question-Level Feedback - They see the feedback for the question as a whole.
         • Selection-Level Feedback - They see the feedback for each answer option.
         • Grader's Comments - They see any comments posted by the grader.
         • Statistics and Histograms - Students see the number of submissions, Total score possible, Mean, Median, Mode, Range, Quartile 1, Quartile 3, Standard Deviation for the entire test. For each individual question, they see the percentage of students who answered correctly.
     • Grading - there are three categories of options under this heading.
       • Students' Identities - Choose your option and whether or not it can be edited in an assessment built on this Assessment Type.
         • Students' identities can be seen by graders
         • Anonymous grading only - note that if you choose this option, there is no way to match a submission to a name, EVER.
       • Gradebook Options - Choose your option and whether or not it can be edited in an assessment built on this Assessment Type.
         • None - no grades. An example would be a practice quiz set up as a study-aid in preparation for an exam.
         • Grades sent to Gradebook - A column is automatically created in the gradebook and scores are sent to that column.
       • Recorded Score if Multiple Submissions per User - this option only applies if you have allowed the students more than one submission under the "Submissions" heading. Choose your option and whether or not it can be edited in an assessment built on this Assessment Type.
         • Record the highest score - out of multiple submissions, the highest current submission will be the one shown in the gradebook. This score will appear in bold font in the gradebook to signify that there was more than one submission.
         • Record the last score - out of multiple submissions, the most recent submission will be the one shown in the gradebook. This score will appear in bold font in the gradebook to signify that there was more than one submission.
       • Graphics - not functional at this time
       • Metadata - not functional at this time
3. Click Save

Create an Assessment in Tests & Quizzes

Now that you have a thorough understanding of Question Pools and Assessment Types, you may begin to build your assessments.

NOTE: You will see the option "Import assessment (from XML or zip file)" and an "Import" button. DO NOT ATTEMPT TO USE THIS OPTION!!! Not only does it not work, but it can corrupt your username so that you can no longer work in Tests & Quizzes. The corruption can be corrected, but it takes time. We are working to have this option removed until it becomes safe and usable.

From within the course where you want to build an assessment,

1. Click Tests & Quizzes in the left menu bar.
2. "Create assessment (enter title):" - enter a title for the assessment.
   1. Select to:
      • "Create using assessment builder" - allows you to type in individual questions, or select questions from question pools, or randomly draw from question pools.
      • "Create using markup text" - this option allows you to cut and paste from a properly formatted text document. There are specific formatting instructions for each question type provided. If you create the test using this method, there are some options that you miss out on - the ability to randomize questions and answers, enter feedback, add attachments, format question text, etc. This option only allows for simple question and answer text. You can always go into the questions once they are created and make adjustments.
   2. "Choose assessment type (optional)" - if you make no selection here, you will be given the default assessment type which is fully editable and uses the most common assessment settings.
      • The "default quiz" option is identical to the default Assessment Type you are assigned if you make no choice here.
      • The "default survey" option is set to the most common survey settings and is fully editable.
      • If you have created any Assessment Types they will show as options here and you may select one of those.
3. Click Create. You are taken to the screen that allows you to add parts and questions to the assessment, the "edit" screen.

Add a Part in Tests & Quizzes

Every assessment must have at least one Part. By default, you are given a Part to which you may add questions. You may add additional Parts that can be revealed to the students or not. You might have one Part that contains all questions from Chapter 1 of the textbook and another Part containing all questions from Chapter 2. You might have a Part that are all multiple choice questions and a second Part containing essay questions. Consider how you want to structure the assessment before you begin building it.

We will continue the tutorial from where we left off in the previous section. From the "edit" screen,

1. Click Add Part
2. "Title" - enter a title for this Part. This is a required field.
3. "Information" - If desired, enter Information about the Part. For example, you may state that this Part contains all questions from Chapter 1 of the textbook.
4. Add attachments if desired by clicking Add Attachments
5. Select how the questions will be added to this Part under the "Type" heading:
   • "Questions authored one-by-one" allows you to create each individual question and they will appear in the order in which you enter them. If you choose this option,
     • Skip down the screen until you see the heading "Question ordering (not available for random draw).
       • Select "As listed on Assessment Questions page" to deliver the questions in the specific order in which you list them.
       • Select "Random within Part" to have the questions randomized for each student.
   • "Random draw from question pool" allows you to select a Question Pool from which a specific number of questions will be randomly drawn. You might choose to draw 10 questions randomly from a Pool of 30 questions. If you choose this option,
     • "Pool name (total # of questions) becomes live and you can select the Pool you want to use from the drop-down menu.
     • "Number of questions" - insert the number of questions that you want to be randomly drawn from this pool.
     • "Point value of questions" - when you added questions to the question pool, they were assigned a point value. You may override that point value here by entering the number of points you want all questions delivered in this Part to be worth.
     • "Negative point value for incorrect answer selection" - enter a number to have that many points removed from a True/False, Multiple Choice,Single Correct question type if the student selects the incorrect answer. This option also overrides whatever was set in each individual question.
     • "Type of randomization" - this option is only applicable if students get multiple attempts. By default, the questions are randomized every time the assessment is delivered. Or you may change it to give the students the same questions in subsequent attempts that they had in their original attempt.
6. Metadata is not currently being used.
7. Click Save

You will be returned to the "edit" screen where you will see your new Part in addition to the default Part that was automatically created when you created the assessment.

NOTE: If you draw questions from a Question Pool, all questions in the pool are copied into the assessment. That means that if you edit a question in your Question Pool, that change will not be reflected in the assessment that pulls from that pool. If you need to change a question, edit the question in the Question Pool, delete the Part that pulls from that pool and recreate the Part.

Add Questions to a Part in Tests & Quizzes

If you are not randomly drawing questions from a Question Pool, you will need to add questions to the Part.

1. On the "edit" screen underneath the Part to which you want to add questions you will see the heading "Insert New Question" beside a "select a question type" drop-down menu. Select the type of question you want to add.
2. The screen opens that allows you to enter the question. Each question type provides instructions for creating that question type.
3. You have the option to assign this question to a different Part by choosing that Part from the "Assign to Part" drop-down menu.
4. You may also assign this question to a Question Pool so that it will be available for future assessments. Select the name of the Question Pool from the "Assign to Question Pool" drop-down menu.
5. Click Save

Create an Assessment for Special Needs Students in Tests & Quizzes

If you have special needs students in your course that require extra time for the assessment, it is simple to duplicate the assessment, adjust the settings to allow for extra time, and assign the duplicate to the students with special needs.

First, you will need to create a group.

Next, duplicate the assessment.

1. From within Tests & Quizzes, click Assessment at the top of the screen, or click the reset icon. You will see the assessment listed under the heading "Pending Assessment."
2. From the "select Action" drop-down menu beside the name of the assessment, click Duplicate.
3. In response to the "Are you sure you want to duplicate this assessment titled . . .?" click Duplicate.
4. You will be returned to the list of "pending" assessments where you see the duplicate with "copy #1" appended to the name. From the "Select Action" drop-down menu beside the name of the duplicate, click either Settings or Publish.
5. Click the triangle beside the words "Assessment Released To" to reveal the options.
   1. Select "Selected Groups."
   2. A list of all groups is shown. Check the box next to the group(s) that will get this assessment
6. Click the triangle beside the words "Timed Assessment" to reveal the options.
   1. Set the time to allow for the extra time for the special needs students.
7. At the bottom of the screen, click Save Settings and Publish.

Publish an Assessment in Tests & Quizzes

Once you have created the Assessment and added your questions, you are ready to set the settings and publish.

1. Across the top of the "edit" screen, click Publish
2. The "settings" screen is revealed. Click "Open All Menus" at the top of the list
3. All available settings will be revealed.
   • If the assessment was created using an Assessment Type other than the default, some of these settings may not be editable and will not appear as an option.
4. Set the settings to deliver the assessment to your specifications. Go to Create an Assessment Type for specific information about each setting. There are a few additional settings in an assessment than in an Assessment Type. Those additional settings are:
   • "Delivery Dates" - each of these dates may be set by clicking the small calendar icon to the right of the box to open a calendar. Click the date you want to enter that date. The default time will be the current time. You may adjust the time within the text box.
     • "Available Date" - The available date is the date and time at which students will be able to access the assessment.
     • "Due Date" - the due date is the date and time at which students will no longer be able to begin taking the assessment.
     • "Retract Date" - this date removes the assessment from the students so they can no longer access it. If you want students to be able to see their results and feedback, do not set the retract date, or set it for a future date that will allow them time to view their submissions after they submit.
   • "Assessment Released To"
     • Anonymous Users - this option would be used if you want to send this assessment to people that are not participants in this course. You could send the URL of this assessment to anyone and they would be able to access it without logging into e-Learning in Sakai. Of course, you would not get grades sent to a gradebook, or know who submitted each submission.
     • "Course Name" - This option would release to all Students, Auditors and CE Students in your course.
     • "Selected Groups" - This option only appears if you have created at least one group in your course. When you select this option, a list of your groups appears and you may check the box beside the group(s) you want to have access. No other users will see the assessment.
5. Click Save Settings and Publish

Edit a Published Assessment in Tests & Quizzes

You can make changes to an assessment once it has been published and even once students have begun submitting. You may make changes to questions, point value, settings, etc. The exception is that you cannot edit questions that are randomly drawn from a pool. If you need to edit a question in a pool, you will have to delete the assessment or Part that pulls from that pool, go to the pool and correct the question(s) and the recreate the assessment or Part.

To edit a published assessment:

1. Under the name of the published assessment, choose "Edit" from the drop-down menu.
2. You see a warning that the assessment will be retracted until the edits are complete. Click Edit.
3. Click Settings to edit the settings for the assessment.
4. Click Edit beside each question that you want to edit.
5. Click Save to save the changes you made.
6. When you are done with your edits, click "Republish" or "Regrade and republish" (if there were submissions that could be affected by your changes).
7. Click Republish

Manage Assessments in Tests & Quizzes

From within Tests & Quizzes, click the Assessments link at the top of the page. You are taken to the page where you may create new assessments and also lists of all assessments that have already been created.

• Pending Assessments

Assessments listed here have been created, but not published. You may edit, remove, publish, duplicate, etc., by using the "Select Action" drop-down menu beside each assessment. "Export" is listed in this drop-down menu, but is not a viable option at this time.

• Published Assessments - Active and Inactive

When an assessment is published, it is copied to this list. You will now see the assessment in both the Pending Assessments list and the Published assessments list. Because this is a copy of the pending assessment, you cannot make a change to the pending one and expect those changes to be reflected in the published one.

Active All assessments in this list may not be visible to students as the "available date" may be in the future, but once the available date has been reached, students will be able to access these assessments. You will be able to tell how many students are currently taking this assessment by the number in the "In Progress" column. The "Submitted" column will show how many students have completed the assessment.

Inactive All assessments in this list are not available to students, either because the due date or retract date have been reached, or because the assessment was manually retracted in the settings.

Using the "Select Action" drop-down menu beside each assessment, you may view:

• • Scores (if there are submissions. You will be able to see how many submissions there are under the "Submitted" column
  • Edit - you do not want to edit a published assessment if there are any students "in progress." You will be able to determine if there are any assessments in progress under the "In Progress" column.
  • Preview - this option allows you to see how the assessment will appear to students. You can answer the questions, but your answers will not be saved and you cannot submit.
  • Settings - you may change settings on a published assessment, but you want to make sure no one is "in progress" before you change settings. Also consider the impact if students have already submitted. Changing the due date might not have much of an impact, but increasing the time allowed would.
  • Remove - if you remove a published assessment, you will lose all submissions.

Manage Student Submissions in Tests & Quizzes

Once students have submitted, you may view their submissions.

View and Edit Student Submissions in Tests & Quizzes

• Locate the assessment in the list of published assessments, either active or inactive. If there are submissions, the "scores" option will be available from the "Select Action" drop-down menu.
  • You will be taken to a screen that shows each submission listed by the student's name (or a submission ID if "anonymous grading" was selected), the role, submit date, score, a text box where you may adjust the score up or down, the final score and a box for Comments.
    • To view a submission, click the hyperlinked name of the student, or the Submission ID. A screen opens that allows you to see each question, the student's answer, the correct answer and points awarded. You may adjust the points awarded and provided comments for each question or for the submission as a whole. When you have completed your changes, click "Update" at the bottom of the screen.
    • To Adjust the total score, enter the adjustment score in the box under the "Adjustment" column. You may enter both positive and negative numbers. For example, "+2" would add to points to the student score. "-2" would take away 2 points.
• Click Update at the bottom of the screen.

Grade Short Answer/Essay, File Upload, Audio Recording Questions in Tests & Quizzes

Some question types must be manually graded. When you view the student submission, these question types will have no grade. You may grade them in this screen, but you will have to sort through all the questions looking for the ones that need manual grading unless you have organized the assessment to group these questions together in one Part.

An easier alternative is to go to the specific question, rather than go to each student submission.

1. On the "scores" screen, click Questions at the top of the screen.
2. You can see each question listed as Q1, Q2, Q3, etc. Click on the number of the question you want to grade. All submissions for that question are displayed and can be graded on this screen.

View Assessment Statistics in Tests & Quizzes

eLearning in Sakai offers statistical information for your assessments. You can see the number of submissions, total possible points, mean, median, mode, range, Quartile 1, Quartile 3 and Standard Deviation. For each individual question, You can see a graph of how many students chose each response and what percentage of the students chose the correct answer. To view these statistics, click Statistics at the top of the "Scores" screen.

The "Item Analysis" at the top of the "Scores" screen will provide a spreadsheet view of each question, how many students answered this question, what percentage of the entire group answered the question correctly, of the upper 27% of the class what percentage answered this question correctly, of the lower 27% of the class what percentage answered this question correctly, Discrim, and how many students chose each option (for multiple choice, true false, matching).

Export Assessment Results in Tests & Quizzes

Click Export at the top of the "Scores" screen to get a spreadsheet of each student's answers and scores.

Allow Student Retake of an Assessment in Tests & Quizzes

If you want to allow a student to retake the assessment without releasing it to the entire class again, you may allow that one student another retake. This option will delete the first submission and allow the student to try again. Remember that if you released the scores and feedback upon submission, the student may have already seen the correct answers, etc. If you are not releasing the scores and feedback until a later date, you know that the student doesn't have the advantage of having seen the correct answers.

1. In the list of "Published" assessments, either active or inactive, click Scores from the drop-down menu beside the assessment.
2. You see the list of all students and whether or not they have submitted. Click Submission Status at the top of the page.
3. Under the name of the student, click Allow retake?
4. In answer to the "Are you sure you want to allow (student name) to submit one more time?", click Retake.

Create a Survey in Tests & Quizzes

Creating a Survey in Tests & Quizzes is exactly like creating an assessment except for the settings. When you create the survey, if you will choose "Default Survey" from the "Choose assessment type (optional)" drop-down menu, your survey will have the most common survey settings. They are all editable so you can make adjustments as needed. The "Default Survey" delivers the survey to anonymous users, anonymous grading, and no grades sent to gradebook.

There is no difference in how survey questions are created, and you will be required to choose a "correct" answer as you create the questions. But when the questions are delivered in the survey, there will be no correct or incorrect answers specified.

Manage submissions exactly like you manage assessment submission in Tests & Quizzes.