Tests & Quizzes

From e-Learning Documentation

(Difference between revisions)
Jump to: navigation, search
(Assessment Types in Tests & Quizzes)
(Create an Assessment Type in Tests & Quizzes)
Line 163: Line 163:
===Create an Assessment Type in Tests & Quizzes===
===Create an Assessment Type in Tests & Quizzes===
-
If you decide you want to create a specific Assessment Type, you must consider all possible settings and how they affect the performance of your assessment. You also must decide what options will be editable once the assessment has been created.  For example, if you set up an Assessment Type with specific settings that are uneditable, a TA or other Instructor, or even yourself, cannot change this setting in an assessment created from this Assessment Type.  This would be helpful if you want to make sure that a specific setting is consistently maintained, but could also cause problems if there was ever a reason you needed to change that setting.  If you make a setting "uneditable," that is permanent for any assessment built on that Assessment Type.  
+
If you decide you want to create a specific Assessment Type, you must consider all possible settings and how they affect the performance of your assessment. You also must decide what options will be editable once the assessment has been created.  For example, if you set up an Assessment Type with specific settings that are uneditable, a TA or other Instructor, or even yourself, cannot change this setting in an assessment created from this Assessment Type.  Many options will disappear altogether if you do not mark them as "editable." This would be helpful if you want to make sure that a specific setting is consistently maintained, but could also cause problems if there was ever a reason you needed to change that setting.  If you make a setting not editable, that is permanent for any assessment built on that Assessment Type.  
# Within Tests & Quizzes, click '''Assessment Types''' at the top of the page.
# Within Tests & Quizzes, click '''Assessment Types''' at the top of the page.
Line 231: Line 231:
#*** Metadata - not functional at this time
#*** Metadata - not functional at this time
# Click '''Save'''
# Click '''Save'''
-
 
-
 
-
 
-
 
-
 
-
 
-
 
-
 
-
 
-
 
-
 
-
You do not have to choose an Assessment Type when creating an Assessment.  If you do not choose an Assessment Type, you will be given a default type that is exactly like the "Default Quiz," utilizing the most commonly used settings.  It is fully editable if you want to change any of the settings.
 

Revision as of 18:42, 6 October 2010

Contents

Tests & Quizzes Overview

The Tests & Quizzes tool provides for online assessment of student knowledge. This assessment can be in the form of for-credit quizzes and exams, or self-assessment study aids. You may also use this tool to create anonymous surveys.

Create and Manage Question Pools in Tests & Quizzes

As you use the Tests & Quizzes tool, you will be creating questions that can be used over and over in other exams in the future. You will want to organize your questions into Question Pools so that you can easily locate the questions you want to use in the future.

Once you have Question Pools, you can create an assessment that will randomly draw from one or more pools. For example, you might create two pools called "Chapter 1 Easy" and "Chapter 1 Difficult" that each contain 25 questions. You can set up an assessment that randomly pulls 5 questions from each of those pools so that all your students get 10 questions - five easy and five difficult - but they could each have an entirely different assessment. If you use this option, your question pool is actually copied into the assessment created. If you change the question in the pool, it will not affect the assessment.

NOTE:Question Pools are associated with your username, not the course in which they are created. So if you create a Question Pool in course ABC1234, and you also teach CBA4321, you will see your Question Pools in both locations and they are available to use in both locations. Because of this, you will want to name your Question Pools in a way that clearly identifies the questions. This also means that you are the only one that can see your Question Pools. If you have a TA or another instructor that needs access to a Question Pool, you must "share" that pool with that person. He/she then has the ability to copy it into his or her own pool.

Create a Question Pool in Tests & Quizzes

Within Tests & Quizzes:

  1. Click Question Pools at the top of the page.
  2. Click Add New Pool
  3. Pool Name* - Type a name for the pool
    • "ABC1234 Textbook" is a name that would identify the source of these questions when you see this pool in other courses you teach.
  4. Fill in any other content that could be helpful to you in the future.
  5. Click Save

Import a Question Pool in Tests & Quizzes

You will see the option to Import a Question Pool. This option is not functional at this time.

Add Questions to a Question Pool in Tests & Quizzes

Within Tests & Quizzes:

  1. Click Question Pools at the top of the page.
  2. Click the hyperlinked name of the Question Pool to which you want to add questions.
  3. A screen opens that shows all the Question Pool information, as well as how many subpools and questions are in the Question Pool. Beside the heading "Question" click Add at the right margin.
  4. Select a question type from the "select a question type" drop-down menu.
    • See Question Types tutorial for an explanation of the various types of questions.
  5. Click Save
  6. Fill out the question information and click Save

Create a Subpool in Tests & Quizzes

Subpools offer another level of organization. If you create a pool called "ABC1234 Textbook," you might create subpools called "Chapter 1," "Chapter 2," etc. In those subpools, you could create more subpools called "Easy," and "Difficult."

Once you create subpools, you will see them listed when you click the hyperlinked name of the Question Pool. You may click the hyperlinked name of the subpools to add questions to subpools.

Within Tests & Quizzes:

  1. Click Question Pools at the top of the page.
  2. Click the hyperlinked name of the Question Pool to which you want to add a subpool.
  3. A screen opens that shows all the Question Pool information, as well as how many subpools and questions are in the Question Pool. Beside the heading "Subpools" click Add at the right margin.
  4. Pool Name* - Type a name for the pool
  5. Fill in any other content that could be helpful to you in the future.
  6. Click Save

Remove, Copy and Move Questions Within Question Pools in Tests & Quizzes

You may remove questions from a pool, copy them into another pool, or move them to another pool. Perhaps you create a Question Pool called "ABC1234 Textbook" in which you gather 200 questions. You decide you would like to organize these questions by chapter and difficulty level. You make subpools called "Chapter 1," "Chapter 2," etc. You may copy the questions into the appropriate subpools, which will mean that the questions are now in both the ABC1234 pool and the subpool. You may move the questions into the subpools, which means that the questions are removed from ABC1234 and are now only in the subpool. If you remove the questions, they are permanently deleted from that pool.

Within Tests & Quizzes:

  1. Click Question Pools at the top of the page.
  2. Click the hyperlinked name of the Question Pool that contains the questions you want to Remove, Copy or Move.
  3. A screen opens that shows all the Question Pool information and lists all questions in that pool. Check the box beside the question(s) you want to Remove, Copy or Move.
  4. Click Remove, Copy, or Move at the top of the list.
    • These links will not be live until you select at least one question.
    1. Remove - You will get a "Remove Question Confirmation" screen that asks if you are sure you want to remove the question(s). The question text will be listed so that you can be sure this is the question you want to remove. Click Remove.
    2. Copy - You will see a list of all available Question Pools into which you may copy the question(s). You can expand the Question Pools to find available subpools by clicking the triangle beside the pool name. Check the box beside the pool where you want to copy the question(s) and click Copy.
    3. Move - You will see a list of all available Question Pools into which you may move the question(s). You can expand the Question Pools to find available subpools by clicking the triangle beside the pool name. Check the box beside the pool where you want to copy the question(s) and click Move.

Share Question Pools with Other Instructor-Type Roles in Tests & Quizzes

Because Question Pools are associated with your username, not the course, if you want other Instructor-Type persons in your course to have access to them, you must "share" the question pool. Once shared, the pool can be copied to that person's pools and will then be available to that person in any course he/she teaches.

Share a Question Pool in Tests & Quizzes

  1. Within Tests & Quizzes, click Question Pools at the top of the page
  2. Beneath the pool or subpool you want to share, click share
  3. A list of people is displayed that all have access to the pool. Unless you have already shared this pool, the list will include only yourself. Below that is a list of eligible Instructor types (Instructor, Designer, Facilitator, Teaching Assistant) to whom you may give access. Check the box beside every person with whom you want to share the pool.
  4. Click Share

Revoke a Shared Question Pool in Tests & Quizzes

You may also remove someone's access to a shared pool. But realize that once you share a pool, the person may copy that pool and then it will be his or her own. In that case, he or she will still have access to those questions.

  1. Within Tests & Quizzes, click Question Pools at the top of the page
  2. Beneath the pool or subpool you want to share, click share
  3. A list of people is displayed that all have access to the pool. Check the box under the "Revoke access" heading and click Share

Copy a Question Pool That Has Been Shared With You in Tests & Quizzes

Once someone shares a pool with you, you can build assessments utilizing the questions in this pool. You can also copy this pool so that the questions are yours. Before you can copy those questions, you must have a pool into which to copy the questions. You may add them to an already existing pool or create a new one. To copy a pool that someone has shared with you:

  1. Within Tests & Quizzes, click Question Pools at the top of the page
  2. You will see the pool that has been shared with you. In the column called "creator," you will see who created this pool and shared it with you. Click Copy underneath the name of the pool.
  3. Your Question Pools will be listed. Check the box beside the pool into which you want the questions copied.
  4. Click Copy

Question Types in Tests & Quizzes

All question types provide the Content Editor when you construct the question so that you can format the question, answer and feedback text, insert links, images, video, etc. There is also the option to add an attachment to the question.

All question types will allow you to provide feedback for each answer option as well as the entire question. You can provide different feedback based on whether the student answered the question correctly or incorrectly.

tutorials for each question type are included on the screen when you are creating the question.

There are nine different question types available in Tests & Quizzes:

Multiple Choice

There are three different types of Multiple Choice questions:

In what city will you find the Yenikapi arhcheological site?

Since the city was named Constantinople in the past, I will allow half credit for this answer.

Multiple Choice questions allow for the answers to be randomized each time the question is displayed to a student so that the correct answer is a different option each time. You can also require the students to provide a rationale for their answer so that you can verify that the student knows the answer and isn't just guessing.

Survey

This question type is primarily used for gathering information from participants in an anonymous survey. It is not possible to assign points for this type of question. There are several answer options, including Likert Scale options.

Short Answer/Essay

Short Answer/Essay questions provides students with a text box for typing their answers. The text box does not provide the Content Editor and has a limit of 4000 characters. If you need students to have the ability to format their text and enter more than 4000 characters, use the "File Upload" question type. This type question is not automatically graded. The instructor must view the student submission and enter a grade.

Fill in the Blank

Fill in the Blank questions ask the student to insert a word or words into the question text to complete a sentence or paragraph. While this question type is automatically graded, the student's entry must match exactly the option(s) provided by the instructor. There is some flexibility in providing acceptable answers, matching case, etc., but the best practice is to only use this type of question with totally unambiguous test questions.

Numeric Response

Numeric Response is essentially a Fill in the Blank type question that uses numbers for the answer instead of words.

Matching

Matching type question require that the student matches one term, phrase or image to another. For example, you could insert an image of a plant and the student would have to choose the name of the plant from a list provided. You must have exactly the same number of items on each list.

True False

True False questions ask the student to determine if a statement is true or false.

Audio Recording

This function is not currently working, but will allow students to record an audio answer to a question - especially good for language classes to test student's pronunciation and conversation skills.

File Upload

This question type asks the student to submit a file as his/her answer to the question. Of course, this question type must be graded manually. The File Upload type can be used in place of the Assignment tool, though the Assignment tool has many more options.

An example of one way to use this question type in an assessment might be that you attach a spreadsheet to the question text and ask students to fill it out and submit it as the question answer. You might also ask them to prepare a file prior to the test and attach it to this question during the test.

Assessment Types in Tests & Quizzes

Assessment Types are a set of pre-determined settings for your assessment. At UF, we have set up default Assessment Types using the most commonly used settings. All settings are editable so you have the ability to change any of them to meet your needs.

By default, you are offered a "Default Quiz" and a "Default Survey" Assessment Type. You also have the ability to create your own Assessment Type. You would only want to do this if you have unusual settings that you use consistently in assessments. Like a Question Pool, if you create an Assessment Type, it is associated with your username, not the course in which it was created. So if you create an Assessment Type in your ABC1234 course, you will also see that Assessment Type in your CBA4321 course. Unlike Question Pools, you cannot share an Assessment Type. If you have other Instructor-Types in your course that need to use your Assessment Type, they will have to create their own based on your settings.

Create an Assessment Type in Tests & Quizzes

If you decide you want to create a specific Assessment Type, you must consider all possible settings and how they affect the performance of your assessment. You also must decide what options will be editable once the assessment has been created. For example, if you set up an Assessment Type with specific settings that are uneditable, a TA or other Instructor, or even yourself, cannot change this setting in an assessment created from this Assessment Type. Many options will disappear altogether if you do not mark them as "editable." This would be helpful if you want to make sure that a specific setting is consistently maintained, but could also cause problems if there was ever a reason you needed to change that setting. If you make a setting not editable, that is permanent for any assessment built on that Assessment Type.

  1. Within Tests & Quizzes, click Assessment Types at the top of the page.
  2. Under the heading "Create a new assessment type" type a Title for the Assessment Type in the box and click Create
    • You are taken to a screen that lists the 13 categories for choosing your settings.
      • Assessment Type Information - this allows an instructor-type role working with the assessment based on this Assessment Type to view the title, author(s) and Description or Introduction to this Assessment Type. Students do not view this info.
      • Assessment Introduction - Your only option here is to decide if these things are editable in the assessment based on this Assessment Type. If you do not check the box, there will be no option to edit the Assessment Author(s) or the Assessment Description/Intro. Check the box next to the item(s) that you want to be editable.
      • Assessment Released to:
        • Anonymous Users - if you choose this option, you may send the assessment to users that are not enrolled in your course, or not even at the University of Florida. For example, you could create a survey that you want to send out to 15 colleagues in several institutions around the country. If you choose the "Anonymous Users" option, you may send the URL to the published survey to these colleagues and they can take the survey without logging in to e-Learning in Sakai. Of course, you will not be able to know the identities of those who took the survey.
        • Site Members - if you choose this option, the assessment goes to all student-type roles in your course.
        • Selected Groups - if you have created groups in your course, you may assign this assessment to a specific group or groups so that they see the assessment and the other students do not.
      • High Security - Your only option here is to decide if these things are editable in the assessment based on this Assessment Type. If you do not check at least one of the boxes, the High Security option will not be available in the assessment based on this Assessment Type.
        • Allow only specified IP Addresses - This option allows an instructor-type role to establish a range of IP addresses that can access the assessment. This is useful if you require the students to take the assessment in a proctored computer lab. If you enter the IP Addresses for that lab, a student using a laptop in the library, for example, cannot access the assessment.
        • Secondary ID and Password - This option allow an instructor to enter an ID and password that must be entered in order to access the assessment. An instructor using a proctored classroom could wait until all students are present and the door is closed before giving out the secondary ID and password.
      • Timed Assessment - Your only option here is to decide if this is editable in an assessment based on this Assessment Type. If you do not check this box, the Timed Assessment option will not be available in any assessment based on this Assessment Type.
      • Assessment Organization - three categories of options are listed here:
        • Navigation - Choose your option and decide if an instructor-type role can change it from whatever you choose as the default.
          • Linear access requires students to answer the questions in the order delivered with no going back to previous questions.
          • Random access allows students to answer the questions in any order and provides a Table of Contents so that students can navigate to various questions.
        • Question Layout - Choose your option and decide if an instructor-type role can edit it.
          • Each Question is on a separate Web page - each question has a "Save" button. This option provides the least chance of losing student work due to technical difficulties such as losing internet connection.
          • Each Part is on a separate Web page - You can create an assessment with one or several parts. For example, you could create a part with questions from Chapter 1 and another part with questions from Chapter 2. If you choose this option, each part has a "Save" button.
          • The complete Assessment is displayed on one Web page - there is only one "Save" button at the end of the assessment. This option runs the risk of losing data in the case of technical issues such as the loss of internet connection.
        • Numbering - Choose your option and decide if an instructor-type role can change whatever you set as default.
          • Continuous numbering between parts - you would use this option if you don't want to show the student that there are multiple parts.
          • Restart numbering for each part - this option makes it more obvious to the student that this is a separate part.
      • Mark for Review - this option is only useful if you have set navigation to random access. The "Mark for Review" feature is supposed to make it easier for students to revisit questions they have skipped before they submit their submission. In reality, it is minimally helpful. If you have allowed students random access to questions, the table of contents will always reveal which questions have not been answered yet. Choose whether or not to include this option and if it is editable in an assessment based on this Assessment Type.
      • Submissions - three categories of options are listed here.
        • Number of Submissions Allowed - Choose your options and decide if an instructor-type role can edit it. Do students get unlimited attempts (for example in the case of a practice quiz) or do they get a certain number of attempts? Select "Only" and enter the number of submissions in the box.
        • Late Handling - Choose your option and decide if an instructor-type role can edit it.
        • Automatic Submission - Choose whether or not to use this feature and whether it can be edited. This option is for assessments that are in progress at the time of the due date. It does not submit an assessment that was never begun.
          • If you chose to allow late submissions, choosing "Automatic Submission" has no effect. If you have an assessment with a time limit of 1 hour and a due date of Sept 12 at 3pm, if a student begins the test at 2:30pm, the student will receive the full hour because you have allowed late submission.
          • If you did not choose to allow late submissions, choosing the "Automatic Submission" option will submit any active assessments at the due date. In the scenario above, if the student logs in at 2:30, he/she will only get 30 minutes to take the assessment. Though the introduction page will show that the assessment time allowed is one hour, when the assessment actually begins, the timer will show 30 minutes. When there are five minutes left, a pop-up box will appear alerting the student that there are only five minutes left. When the time has expired, another box will pop-up that says that the time has expired and the assessment has been submitted.
      • Submission Message - If you check either or both of these boxes, this option will be available to you as you create the assessment.
        • Submission Message - this option provides the opportunity to create a custom message for the students that appears when they submit the assessment. Examples might be that you use this option to tell them when the grades will be released, or to direct them what to do once they've submitted.
        • Final Page URL allows you to create a link to web content - either a URL for a file in Resources or other website. When students submit their assessment the link will be available on the submission page.
      • Feedback - There are three categories of options under this heading.
        • Feedback Authoring - Choose which feedback options you want to be available as individual questions are created in the assessment and whether or not this can be edited.
          • Question-Level Feedback - This feedback would reference the question as a whole.
          • Selection-Level(A,B,C. . .) Feedback - This would allow the person creating the question to provide feedback for each answer option.
          • Both - Feedback options will be available for both the question as a whole and the individual answer options.
        • Feedback Delivery - Choose your option and if it will be editable in assessments based on this Assessment Type.
          • Immediate feedback - Students see the feedback as soon as they answer the question.
          • Feedback on Submission - Students see the feedback as soon as the assessment is submitted.
          • Feedback will be displayed to the student at a specific date - you determine when the feedback is displayed.
          • No feedback will be displayed to the student
        • Feedback Components Students Can See: - Choose your option(s) and if it will be editable in assessments based on this Assessment Type.
          • Student Response - Students see the answer they chose for this question.
          • Correct Response - Students see the correct answer to the question.
          • Student's Assessment Score - They see the total score for the assessment.
          • Student's Question Scores - They see the score for each individual question.
          • Question-Level Feedback - They see the feedback for the question as a whole.
          • Selection-Level Feedback - They see the feedback for each answer option.
          • Grader's Comments - They see any comments posted by the grader.
          • Statistics and Histograms - Students see the number of submissions, Total score possible, Mean, Median, Mode, Range, Quartile 1, Quartile 3, Standard Deviation for the entire test. For each individual question, they see the percentage of students who answered correctly.
      • Grading - there are three categories of options under this heading.
        • Students' Identities - Choose your option and whether or not it can be edited in an assessment built on this Assessment Type.
          • Students' identities can be seen by graders
          • Anonymous grading only - note that if you choose this option, there is no way to match a submission to a name, EVER.
        • Gradebook Options - Choose your option and whether or not it can be edited in an assessment built on this Assessment Type.
          • None - no grades. An example would be a practice quiz set up as a study-aid in preparation for an exam.
          • Grades sent to Gradebook - A column is automatically created in the gradebook and scores are sent to that column.
        • Recorded Score if Multiple Submissions per User - this option only applies if you have allowed the students more than one submission under the "Submissions" heading. Choose your option and whether or not it can be edited in an assessment built on this Assessment Type.
          • Record the highest score - out of multiple submissions, the highest current submission will be the one shown in the gradebook. This score will appear in bold font in the gradebook to signify that there was more than one submission.
          • Record the last score - out of multiple submissions, the most recent submission will be the one shown in the gradebook. This score will appear in bold font in the gradebook to signify that there was more than one submission.
        • Graphics - not functional at this time
        • Metadata - not functional at this time
  3. Click Save
Personal tools
Namespaces
Variants
Actions
Navigation
Toolbox