Assessment

From e-Learning Documentation

(Difference between revisions)
Jump to: navigation, search
(fixing some typos)
(Add Questions to a Question Pool in Assessments)
 
(52 intermediate revisions not shown)
Line 1: Line 1:
== Overview  ==
== Overview  ==
-
There are two online testing tools in e-Learning, Assessments and [[Tests & Quizzes]]. You may choose whichever of these tools best meets your needs. In general, Assessments is easier to use and offers some very nice functions that are not present in Tests & Quizzes. But Assessments does not have the option to give a test to a Group (There is a workaround if your class and the number of groups is small) where Tests & Quizzes does. Also, Assessments has no option to export test results to a spreadsheet, but Tests & Quizzes does. If you require the use of Groups, or the ability to export to a spreadsheet, you must use Tests & Quizzes. Most everyone else will find that Assessments meets their needs very well.  
+
There are two online testing tools in e-Learning, Assessments and Tests & Quizzes. Assessments is almost always the best choice. Assessments is easier to use, offers several nice features that are not available in Tests & Quizzes, and performs with far fewer problems than Tests & Quizzes.
-
In Assessments, if you organize your questions into Question Pools, all questions in a pool must be the same point value and difficulty level. This is a good practice and a helpful way to set up your Question Pools, resulting in a very nicely organized collection of Question Pools.  
+
Assessments has an easy process for assigning an assessment to special needs students that need added time, but there is no option to assign an assessment to a group. The "special access" option can be used to set up a test for a group if the course and number of groups is small, but would not be practical for a large class with lots of groups. The "special access" process allows you to give different access to various students without having to duplicate the test.
-
Assessments has an easy process for assigning an assessment to special needs students that need added time, ''but'' there is no option to assign an assessment to a group. The "special access" option can be used to set up a test for a group if the course and number of groups is small, but would not be practical for a large class with lots of groups. The "special access" process allows you to give different access to various students ''without'' having to duplicate the test. This simplifies grading. In Tests & Quizzes, you must republish the test in order to give it to special needs students. This requires that you must deal with two (or more) instances of the same test.  
+
Assessments offers the option to require students to acknowledge the Honor Code before they can submit the assessment.
-
Assessments offers the option to require students to acknowledge the Honor Code before they can submit the assessment. Tests & Quizzes does not offer this.  
+
Question Pools and tests can be imported from Tests & Quizzes into Assessments.
-
Question Pools and tests can be imported from Tests & Quizzes into Assessments, but not the other way around.  
+
In Tests & Quizzes, Question Pools are associated with the creator's Username, not the course in which the pools were created. So if you are instructor for ABC1234 and CBA4321 and you create five Question Pools in ABC1234, you will also see those five pools when you go to your CBA4321 course. This is helpful in that you always have access to your Question Pools, but it requires you to pay attention to naming conventions. You would not want to name a Question Pool "Exam 1." It also presents problems because other instructors, TAs, and help desk staff cannot access your pools to assist you in test creation.
-
Assessments seems to work better than Tests & Quizzes in really large enrollment (>1000) courses.  
+
In Tests & Quizzes, if you insert images into the Content Editor in the question body or in the answers, those images will be broken when the test is imported into future semesters. You can add the image as an attachment and it will appear at the bottom of the text. Students do not have to click an attachment to open it. Assessments has a more reliable way to insert images, but requires some pre-planning if you have a large number of images (more than ~100) that you will be using in the test.
-
Assessments offers a real "test drive" that allows you to fully test the assessment so you are confident that it performs for the students as expected. Tests & Quizzes does not offer this.
+
NOTE:  Currently, the "Survey" option in Assessments isn't working correctly. Do not use Assessments for creating surveys. Qualtrics is your best tool for creating surveys.
-
 
+
-
Assessments allows you to edit a published test, even if the test is randomly drawing questions from a Question Pool. In Tests & QUizzes, you may edit a test ''unless'' you are randomly drawing questions from a Question Pool.
+
-
 
+
-
In Tests & Quizzes, you cannot insert images into the Content Editor in the question body or in the answers. You can add the image as an attachment and it will appear at the bottom of the text. Students do not have to click an attachment to open it. In Assessments, you may insert images into the text of the question with no problems.  
+
== Create and Manage Question Pools in Assessments  ==
== Create and Manage Question Pools in Assessments  ==
 +
[[File:video.jpg]] [https://elearning2.courses.ufl.edu/access/content/group/aff6109c-e3a7-4bb5-8b1f-63a7642daec0/Sakai%20Assessments/sakai-assessments-questionpools/sakai-assessments-questionpools.html Video Tutorial]
You do not have to use Question Pools, but they are a good resource for building, maintaining and storing questions that are available to be used in building tests. They also allow for building an assessment that randomly pulls questions from a pool so that two students taking the same exam will be presented with different questions. Because Question Pools contain questions with the same difficulty level, it is easy to create a test that will, for example, deliver 10 randomly drawn easy questions and 5 randomly drawn difficult questions.  
You do not have to use Question Pools, but they are a good resource for building, maintaining and storing questions that are available to be used in building tests. They also allow for building an assessment that randomly pulls questions from a pool so that two students taking the same exam will be presented with different questions. Because Question Pools contain questions with the same difficulty level, it is easy to create a test that will, for example, deliver 10 randomly drawn easy questions and 5 randomly drawn difficult questions.  
Line 44: Line 41:
#*Complete the question creation screen. Each question type provides instructions for creating that type of question on the question creation screen.
#*Complete the question creation screen. Each question type provides instructions for creating that type of question on the question creation screen.
#Click '''Done''' or '''Add Another'''
#Click '''Done''' or '''Add Another'''
 +
'''NOTE:''' Inserting images is simple using the insert image icon in the content editor.  Images used in Assessments are NOT stored in Resources, but in the Assessments tool own file storage system. Once images are in the Assessments file storage, they cannot be removed or moved into a different folder.  This prevents breaking links in the questions, but means you need to be very careful to upload the correct image into the correct folder.
=== Create a Question Pool by using "Copy and Paste" from a Properly Formatted Text Document in Assessments  ===
=== Create a Question Pool by using "Copy and Paste" from a Properly Formatted Text Document in Assessments  ===
Line 50: Line 48:
#Using Wordpad or other plain text editor, enter tests questions using the [[Media:Format-assessments.png|proper format]]:  
#Using Wordpad or other plain text editor, enter tests questions using the [[Media:Format-assessments.png|proper format]]:  
 +
#*'''NOTE:''' The recommendation to use Wordpad or plain text editor is due to the fact that new versions of MS Word put in lots of formatting by default - spacing, indenting for example.  If you are comfortable enough with Word to know how to turn off the default formatting, feel free to use it.  If you copy from Word into a plain text editor, make sure you scan the text for extraneous spaces or gaps in text that could cause problems in the question creation process. We also recommend that you test drive the completed assessment before releasing it to students.
#From within the Question Pool screen (Assessments > Question Pools) click '''Import'''  
#From within the Question Pool screen (Assessments > Question Pools) click '''Import'''  
#Select "Paste Questions & Import"  
#Select "Paste Questions & Import"  
Line 59: Line 58:
==== Import a Question Pool from Tests & Quizzes  ====
==== Import a Question Pool from Tests & Quizzes  ====
-
If you have been using Tests & Quizzes but would like to move to the Assessments tool, it is fairly simple to import Question Pools and tests. Go [[T & Q to Assessments|here]] for instructions.  
+
If you have been using Tests & Quizzes but would like to move to the Assessments tool, it is fairly simple to import Question Pools and tests. Go [[T and Q to Assessments|here]] for instructions.
==== Delete, Copy and Move Questions Within Question Pools in Assessments  ====
==== Delete, Copy and Move Questions Within Question Pools in Assessments  ====
Line 135: Line 134:
== Create an Assessment in Assessments  ==
== Create an Assessment in Assessments  ==
 +
[[File:video.jpg]] [https://elearning2.courses.ufl.edu/access/content/group/aff6109c-e3a7-4bb5-8b1f-63a7642daec0/Sakai%20Assessments/sakai-assessments-create/sakai-assessments-create.html Video Tutorial]
You may construct an assessment using questions pulled randomly from the Question Pools, questions specifically chosen from the Question Pools, or questions that you create directly in the assessment. Questions created within the assessment will automatically create a corresponding pool with zero points and the default "3" difficulty level. It can be edited at any time.  
You may construct an assessment using questions pulled randomly from the Question Pools, questions specifically chosen from the Question Pools, or questions that you create directly in the assessment. Questions created within the assessment will automatically create a corresponding pool with zero points and the default "3" difficulty level. It can be edited at any time.  
Line 143: Line 143:
#*Test - a tool to evaluate student knowledge.  
#*Test - a tool to evaluate student knowledge.  
#*Assignment - this option behaves exactly like a Test, but it gives a different icon [[Image:Assessment-assignment.png]]beside the name of the assessment in the assessment list.  
#*Assignment - this option behaves exactly like a Test, but it gives a different icon [[Image:Assessment-assignment.png]]beside the name of the assessment in the assessment list.  
-
#*Survey - the survey is intended to gather opinions from anonymous users. There are no correct answers or points awarded.
+
#*Survey - the survey is intended to gather opinions from anonymous users. There are no correct answers or points awarded.  '''NOTE:''' Surveys are designed to ''guarantee'' anonymity.  You will not be able to see individual responses, only an overall report of answers chosen.  Once you have set an assessment to be a survey you cannot change it back to a test or assignment.  If you want to give a survey, your best option is to use [[Qualtrics]].
#"Title" - enter a descriptive title for this assessment  
#"Title" - enter a descriptive title for this assessment  
#Click '''Edit Instructions''' if you want to give the students additional instructions. By default, the assessment will provide information such as dates available, time limit, attempts allowed, how to navigate through the test, etc.  
#Click '''Edit Instructions''' if you want to give the students additional instructions. By default, the assessment will provide information such as dates available, time limit, attempts allowed, how to navigate through the test, etc.  
Line 153: Line 153:
##Click '''Done'''.
##Click '''Done'''.
-
You will notice that your parts will have the yellow triangle icon until you add questions. This is simply an alert to let you know there are no questions yet.  
+
You will notice that your parts will have the yellow triangle icon until you add questions. This is simply an alert to let you know there are no questions yet.
== Add Questions to an Assessment in Assessments  ==
== Add Questions to an Assessment in Assessments  ==
Line 172: Line 172:
== Publish an Assessment in Assessments  ==
== Publish an Assessment in Assessments  ==
 +
[[File:video.jpg]][https://elearning2.courses.ufl.edu/access/content/group/aff6109c-e3a7-4bb5-8b1f-63a7642daec0/Sakai%20Assessments/sakai-assessments-publish/sakai-assessments-publish.html Video Tutorial]
Once you have an assessment with at least one Part and questions, you are ready to determine how you want the assessment to be delivered to the students.  
Once you have an assessment with at least one Part and questions, you are ready to determine how you want the assessment to be delivered to the students.  
Line 187: Line 188:
##"Open" - this is the date and time that the assessment becomes available for students. If you do not enter anything, the assessment will be available as soon as you publish. Click the calendar [[Image:Assessments-calendar.png]]icon to choose a date and time. Set the time first and then click on the date.  
##"Open" - this is the date and time that the assessment becomes available for students. If you do not enter anything, the assessment will be available as soon as you publish. Click the calendar [[Image:Assessments-calendar.png]]icon to choose a date and time. Set the time first and then click on the date.  
##"Due" - this is the date and time after which the assessment is considered "late." Click the calendar icon to choose a date and time. Set the time first and then click on the date.  
##"Due" - this is the date and time after which the assessment is considered "late." Click the calendar icon to choose a date and time. Set the time first and then click on the date.  
-
##"Accept Until" - this is the date and time after which the assessment will no longer be available to students. If you make this the same as the "Due" date and time, late submissions will not be accepted. An example of how this would be used is if your students are allowed 30 minutes to take the test and the Due Date is 3pm today. A student who logs in to begin the test at 2:55pm will only get 5 minutes to take the test. If you make the "Accept Until" date as today at 3:30pm, a student beginning the test at 2:55 will still have the full 30 minutes to take the test. It will be marked "Late" since it will be submitted after the Due Date is passed.  
+
##"Accept Until" - this is the date and time after which the assessment will no longer be available to students. If you leave this blank, or make it the same as the "Due" date and time, late submissions will not be accepted. An example of how this would be used is if your students are allowed 30 minutes to take the test and the Due Date is 3pm today. A student who logs in to begin the test at 2:55pm will only get 5 minutes to take the test. If you make the "Accept Until" date as today at 3:30pm, a student beginning the test at 2:55 will still have the full 30 minutes to take the test. It will be marked "Late" since it will be submitted after the Due Date is passed.  
##"Tries" - How many attempts do the students get? Default is that they get one attempt. You may change the number to anything you want, or change the selection to "Unlimited."  
##"Tries" - How many attempts do the students get? Default is that they get one attempt. You may change the number to anything you want, or change the selection to "Unlimited."  
##"Time Limit" - The default is that there is no time limit. If you want to provide a time limit, change the selection to "Timed" and enter the time. Click '''Instructions''' to see the format for entering the time.  
##"Time Limit" - The default is that there is no time limit. If you want to provide a time limit, change the selection to "Timed" and enter the time. Click '''Instructions''' to see the format for entering the time.  
Line 206: Line 207:
#Send to Gradebook - if you check this box, a column is automatically created in the Gradebook(2). Data in the gradebook column cannot be edited within the Gradebook(2). All grade edits must be done within the Assessments tool.  
#Send to Gradebook - if you check this box, a column is automatically created in the Gradebook(2). Data in the gradebook column cannot be edited within the Gradebook(2). All grade edits must be done within the Assessments tool.  
#Anonymous Grading - This option hides the username so the assessment can be evaluated without knowing who submitted the assessment. To restore the student names after grading is complete, come back to settings and uncheck this box.  
#Anonymous Grading - This option hides the username so the assessment can be evaluated without knowing who submitted the assessment. To restore the student names after grading is complete, come back to settings and uncheck this box.  
-
#Automatically Email Results - This option is
 
#Password - if desired, enter a password that students must enter before they will be granted access to the assessment. This option could heighten security for proctored classrooms if the password is not given out until all participants are gathered in the classroom.  
#Password - if desired, enter a password that students must enter before they will be granted access to the assessment. This option could heighten security for proctored classrooms if the password is not given out until all participants are gathered in the classroom.  
 +
#Require Locked Browser - The Locked Browser is an added security feature which completely disables all aspects of the computer except for those needed to access, take and submit the test.  Students may not go to other websites, open files, open other applications, copy or print the screen.  If a student tries to access a LockDown assessment in a traditional browser, she/he will be blocked from proceeding.  Students that do not have the browser installed on their computer when they try to access the test will be given [http://www.respondus.com/lockdown/information.pl?ID=364713981 | a link to download the browser].  (The LockDown browser is installed on computers in computer labs on campus.)  Students install the browser which automatically directs to the e-Learning log-in page. They are unable to navigate to any other page.  They login to e-Learning and begin their test.  The only way to get out of the Lockdown browser is to submit the test.
 +
'''NOTE:''' You ''must'' choose "Force Completion" (see below) in addition to the "Require Locked Browser" option if you do not want students to be able to exit the test.  Because the Assessments tool offers the "continue later" button, students can use that to leave the test and come back later.  The timer will continue to count down, but students can log back in and continue as long as there is time left on the clock.  Essentially, the LockDown browser is ineffective without the additional option, "Force Completion."  Once Force Completion has been selected, the "continue later" button is removed from the test and the only way to get out of the LockDown browser is to submit the test.  The student could shut down the computer, but this action will submit the student's test, prohibiting the student from returning to the test.
 +
##None - no lockdown browser is required.
 +
##Respondus LockDown Browser - Students can only take the test within the LockDown browser.
 +
##Exit Password (optional) - The password is not functional at this time. 
 +
##Force Completion - If this option is selected, the only way to leave the test or the browser is to submit the test.  Checking this box removes the "Continue Later" button from the assessment.  ''If you do not check this option, students may leave the test and come back to it at will, as long as there is time left on the clock.''
 +
'''NOTE:''' If you intend to use the LockDown browser, we highly recommend that you give students a "practice" test that will allow them to download the browser and try out this technology PRIOR to having to use it for a graded quiz or exam.  You can make a test with one question on it, such as "Did you successfully install the LockDown Browser?" Make the test have a time limit of 30 minutes and provide multiple attempts so that if students encounter difficulties with the process, they get another attempt.  Direct students with technical difficulties to the UF Computing Help Desk at 352.392.4357.
#Honor Pledge - If you check this box, students will be required to check a box acknowledging the honor pledge before they are allowed to begin their assessment.  
#Honor Pledge - If you check this box, students will be required to check a box acknowledging the honor pledge before they are allowed to begin their assessment.  
#Hints - if you have provided "hints" during the construction of your questions, you may check this box to show the hints during the delivery of the assessment.  
#Hints - if you have provided "hints" during the construction of your questions, you may check this box to show the hints during the delivery of the assessment.  
Line 214: Line 221:
#*"Strict order" - The questions must be answered in the order in which they are delivered. There is no going back to a previous question.
#*"Strict order" - The questions must be answered in the order in which they are delivered. There is no going back to a previous question.
#Layout  
#Layout  
-
#*"One question per page" - each question is displayed on its own webpage.  
+
#*"One question per page" - each question is displayed on its own webpage. This option is highly recommended!  Every time students move from one question to the next, the "Save" is activated.  They can access all questions from the Table of Contents.
-
#*"One part per page" - each Part is displayed on its own webpage.  
+
#*"One part per page" - each Part is displayed on its own webpage. Use this only if your parts are small (<5 questions) to lessen the possibility of lost answers.
-
#*"All questions on one page" - the entire assessment is displayed on one page.
+
#*"All questions on one page" - the entire assessment is displayed on one page. This option is NOT recommended. If students lose internet connection they could lose answers.
#Part Numbering  
#Part Numbering  
#*"Continuous" - questions are numbered sequentially, regardless of how many Parts there are.  
#*"Continuous" - questions are numbered sequentially, regardless of how many Parts there are.  
Line 286: Line 293:
*[[Image:Assessments-no-questions.png]]means the assessment has no questions and cannot be published.  
*[[Image:Assessments-no-questions.png]]means the assessment has no questions and cannot be published.  
-
*[[Image:Assessments-live.png]]means the assessment is currently available to students.  
+
*[[Image:Assessments-live.png]]means the assessment has been accessed by at least one student.  
-
*[[Image:Assessments-ungraded-submissions.png]]means the assessment has submissions that need to be graded.
+
*[[Image:Assessments-ungraded-submissions.png]]means that there are submissions that contain essay questions and must be manually graded.
=== Unpublish an Assessment in Assessments  ===
=== Unpublish an Assessment in Assessments  ===
Line 331: Line 338:
#Click '''OK'''
#Click '''OK'''
-
The assessment is now in the list of available assessment.  
+
The assessment is now in the list of available assessment.
== Manage Student Submissions in Assessments  ==
== Manage Student Submissions in Assessments  ==
 +
[[File:video.jpg]][https://elearning2.courses.ufl.edu/access/content/group/aff6109c-e3a7-4bb5-8b1f-63a7642daec0/Sakai%20Assessments/sakai-assessments-submissions/sakai-assessments-submissions.html Video Tutorial]
Once students begin to take the assessments, you will be able to view their submissions, add comments and grade those questions that require manual grading.  
Once students begin to take the assessments, you will be able to view their submissions, add comments and grade those questions that require manual grading.  
Line 383: Line 391:
#Click '''Summary of Data''' at the top of the list.
#Click '''Summary of Data''' at the top of the list.
-
== Create a Survey in Assessments ==
+
==Create a Survey in Assessments==
-
 
+
-
A Survey can be created that will gather anonymous opinions from participants. Create a [[Assessment#Create_a_Question_Pool_in_Assessments|Question Pool]] that contains your Survey Questions before you create the Survey. Survey questions can be created using any question type. As you create each question, you can check the box which designates this question as a survey question, which will remove the option to designate a correct answer. Once you have your questions in a pool, you may create the Survey.
+
-
 
+
-
Creating a Survey is exactly like [[Assessment#Create_an_Assessment_in_Assessments|creating an assessment]] except that you choose "Survey" under "Type."
+
-
 
+
-
Managing Survey submissions is exactly like [[Assessment#Manage_Student_Submissions_in_Assessments|managing assessment submissions]].
+
-
 
+
-
== Create and Manage Question Pools in Assessments  ==
+
-
 
+
-
As noted above, Question Pools are required in Assessments. You must create Question Pools before you may create an assessment.
+
-
 
+
-
=== Create a Question Pool in Assessments  ===
+
-
 
+
-
From within the course where you want to create a Question Pool:
+
-
 
+
-
#Click '''Assessments''' in the left menu bar.
+
-
#At the top of the Assessments page, click '''Question Pools'''
+
-
#Click '''Add Pool'''
+
-
#"Pool Title" - enter a descriptive title for this Question Pool
+
-
#"Description" - you may enter a description of this pool if desired. The Content Editor is available if you want to format this text.
+
-
#"Point Value" - you must enter a Point Value that will be applied to every question in this Question Pool. It is not possible to have questions with different point values in the same Question Pool.
+
-
#"Difficulty" - select the difficulty level of the questions in this Question Pool. It is not possible to hvae questions with different difficulty levels in the same Question Pool.
+
-
#Click '''Done'''
+
-
 
+
-
=== Add Questions to a Question Pool in Assessments  ===
+
-
 
+
-
When the Question Pool is created, you are taken to a screen that allows questions to be added. If you want to add questions to a Question Pool that was previously created, access this screen by clicking '''Assessments &gt; Question Pools &gt; Hyperlinked Name of Question Pool'''.
+
-
 
+
-
#Click '''Add Question'''
+
-
#Select [[Assessment#Question_Types_in_Assessments|Question Type]]
+
-
#Click '''OK'''
+
-
#*Each question type provides instructions for creating that type of question on the question creation screen.
+
-
#Click '''Done'''
+
-
 
+
-
=== Import a Question Pool in Assessments  ===
+
-
 
+
-
You may import a properly formatted text document of questions. This process creates a new Question Pool.
+
-
 
+
-
#Using Wordpad or other plain text editor, enter tests questions using the [[Media:Format-assessments.png|proper format]]:
+
-
#From within the Question Pool screen (Assessments &gt; Question Pools) click '''Import'''
+
-
#Select "Paste Questions &amp; Import"
+
-
#Copy the text from your document and paste it in the box provided in e-Learning. Make sure that there is a space between each question.
+
-
#Click '''OK'''
+
-
 
+
-
If the import was successful a new question pool was created. The newly created Question Pool will be untitled and not have points associated with it. The difficulty level will be at the default, "Level 3." To edit the Question Pool details, click on the "Edit Tool"[[Image:Assessments-edit-pool.jpg]] icon beside the name of the Question Pool. On this screen you are able to rename the Question Pool, provide a Description if desired, enter the Point Value and adjust the Difficulty Level.
+
-
 
+
-
==== Import a Question Pool from Tests &amp; Quizzes  ====
+
-
 
+
-
You may import a Question Pool or a complete Assessment from Tests &amp; Quizzes, but be aware that because of the requirements in Assessments that questions in a question pool all have the same point value, when it imports the pool, it will average the points of all the questions, and that will be the point value for the pool.
+
-
 
+
-
#Click '''Question Pools''' at the top of the Assessment page
+
-
#Click '''Import'''
+
-
#Click '''Import Pools from T&amp;Q'''
+
-
#A list of all Question Pools associated with your username will be shown. Check the box beside the pool(s) you want to import into Assessments.
+
-
#Click '''OK'''
+
-
 
+
-
You are returned to your list of question pools and will see your new pool listed. It will say (imported on date and time) beside the name of the pool.
+
-
 
+
-
=== Import Assessments as Pools from Tests &amp; Quizzes  ===
+
-
 
+
-
You may also import an entire assessment into a Question Pool in the Assessments tool.
+
-
 
+
-
#Click '''Question Pools''' at the top of the Assessments page.
+
-
#Click '''Import'''
+
-
#Click '''Import Assessments as Pools from T&amp;Q'''
+
-
#A list of all the courses in which you have Instructor or Facilitator access will be displayed. Select the course that contains the assessment you want to import.
+
-
#Click '''OK'''
+
-
#Check the box beside the assessment(s) you want to import into Assessments.
+
-
#Click '''OK'''
+
-
 
+
-
You are returned to your list of question pools and will see your new pool listed. It will say (imported on date and time) beside the name of the pool.
+
-
 
+
-
<br>To edit the Question Pool details (change the name, assign a different point value, change the difficulty level) click on the "Edit Tool" [[Image:Assessments-edit-pool.jpg]] icon beside the name of the question pool. If you want the questions to be different point values, you will need to move those questions into different pools. For example: In T&amp;Q the pool had five questions, three of which were worth 2 points and 2 of which were worth 5 points. Once you import the pool into Assessments, the point value of the pool will be 3.5 (the average of the points.) You can edit the pool to be worth 2 points and move the two 5-point questions into another pool. The following tutorials will guide you through the process of moving questions into different pools.
+
-
 
+
-
==== Remove, Copy and Move Questions Within Question Pools in Assessments  ====
+
-
 
+
-
===== Remove Questions from Question Pools in Assessments  =====
+
-
 
+
-
#Open the Question Pool (Assessments &gt; Question Pools &gt; Click the hyperlinked name of the Question Pool) that contains the question(s) you want to Remove (delete).
+
-
#Check the box next to the name of the question(s) you want to remove.
+
-
#Click '''Delete'''
+
-
#In response to the "Are you sure you want to delete the selected questions?" click '''Delete'''.
+
-
 
+
-
===== Copy Questions from one Question Pool to Another in Assessments  =====
+
-
 
+
-
If you copy a question to a different pool, the question will then appear in both question pools.
+
-
 
+
-
#Open the Question Pool (Assessments &gt; Question Pools &gt; Click the hyperlinked name of the Question Pool) that contains the question(s) you want to copy to a different pool.
+
-
#Check the box next to the name of the question(s) you want to copy.
+
-
#Click '''Copy to Pool'''
+
-
#A screen is opened showing all available pools. Select the pool to which you want to copy the question.
+
-
#Click '''OK'''.
+
-
 
+
-
===== Move Questions from one Question Pool to Another in Assessments  =====
+
-
 
+
-
If you move a question to a different pool, the question will be removed from the original pool and placed in the new pool.
+
-
 
+
-
#Open the Question Pool (Assessments &gt; Question Pools &gt; Click the hyperlinked name of the Question Pool) that contains the question(s) you want to move to a different pool.
+
-
#Check the box next to the name of the question(s) you want to move.
+
-
#Click '''Move to Pool'''
+
-
#A screen is opened showing all available pools. Select the pool to which you want to move the question.
+
-
#Click '''OK'''
+
-
 
+
-
== Question Types in Assessments  ==
+
-
 
+
-
There are several types of questions available in Assessments. When you create each of these question types, you will be given instructions on how to compose the question if it is not obvious. Below is a brief description of each type and when you might want to use it.
+
-
 
+
-
=== Multiple Choice  ===
+
-
 
+
-
There are two types of Multiple Choice questions:
+
-
 
+
-
*Single Correct - there is only one acceptable answer
+
-
*Multiple Correct, Multiple Selection - there are several options that are considered "correct" and students may choose more than one. '''NOTE:''' This type of question removes credit for a wrong answer. For example, a question is worth 3 points. There are 7 possible answers and 3 of those answers are correct and 4 are incorrect. A student selects 2 of the correct answers, but one incorrect answer. The student will be awarded a score of 1. She got 2 points for the two correct answers, but lost a point for the incorrect answer. If you do not want students to lose points for incorrect answers, you will have to manually give the credit for the question. Students can not score lower than 0, even if they chose all incorrect answers.
+
-
 
+
-
Multiple Choice questions allow for the answers to be randomized each time the question is displayed to a student so that the correct answer is a different option each time. You can also require the students to provide a rationale for their answer so that you can verify that the student knows the answer and isn't just guessing.
+
-
 
+
-
==== True/False  ====
+
-
 
+
-
True/False questions ask the student to determine if a statement is true or false.
+
-
 
+
-
==== Essay  ====
+
-
 
+
-
Essay questions provide two ways for students to submit their answers.
+
-
 
+
-
*A text box with a Content Editor
+
-
*The ability to attach a file to the question
+
-
 
+
-
The instructor decides to allow one or both of these options. This question type must be manually graded.
+
-
 
+
-
==== Fill In The Blank  ====
+
-
 
+
-
Fill in the Blank questions ask the student to insert a word or words into the question text to complete a sentence or paragraph. While this question type is automatically graded, the student's entry must match exactly the option(s) provided by the instructor. There is some flexibility in providing acceptable answers, matching case, etc., but the best practice is to only use this type of question with totally unambiguous test questions.
+
-
 
+
-
==== Matching  ====
+
-
 
+
-
Matching type question require that the student matches one term, phrase or image to another. For example, you could insert images of plants and the student would have to choose the name of the plant from a list provided.
+
-
 
+
-
==== Likert Scale  ====
+
-
 
+
-
This question type is only available as a Survey question. The participants answer this question using a scale chosen by the instructor, such as: "On a scale of 1-10, what did you think of . . .?"
+
-
 
+
-
==== Task  ====
+
-
 
+
-
This question type is exactly like Essay, except that you have the added option to say "No answer is expected for this question." You would use this option if the student was going to be graded on, for example, an in-class performance. This is comparable to the "non-electronic" submission feature in Assignments. This question type must be manually graded.
+
-
 
+
-
== Create an Assessment in Assessments  ==
+
-
 
+
-
Once you have constructed your Question Pools, you can create Assessments. From within the course where you want to create an Assessment:
+
-
 
+
-
#Click '''Assessments'''
+
-
#You are taken to the main Assessments page. Click '''Add'''.
+
-
#Select from one of three types of assessments:
+
-
#*Test - a tool to evaluate student knowledge.
+
-
#*Assignment - this option behaves exactly like a Test, but it gives a different icon [[Image:Assessment-assignment.png]]beside the name of the assessment in the assessment list.
+
-
#*Survey - the survey is intended to gather opinions from anonymous users. There are no correct answers or points awarded.
+
-
#"Title" - enter a descriptive title for this assessment
+
-
#Click '''Add Instructions''' if you want to give the students additional instructions. By default, the assessment will provide information such as dates available, time limit, attempts allowed, etc.
+
-
#Click '''Done'''
+
-
 
+
-
The assessment will have the invalid [[Image:Assessments-no-questions.png]]icon beside it until questions are added.
+
-
 
+
-
=== Add a Part in Assessments  ===
+
-
 
+
-
Every assessment must have at least one Part. You may add many Parts, using them to organize the questions in the assessment. You might have a Part that pulls 10 random easy questions from a Question Pool and a Part that pulls 5 random difficult questions from a different Question Pool. You may add specific instructions for each Part.
+
-
 
+
-
To add a Part:
+
-
 
+
-
#Click on the hyperlinked name of the Assessment. Under the heading "Add Parts" you have two options:
+
-
#*"Add Manual Select" - this option shows all questions from all pools and allows you to check a box to add this question to the Part.
+
-
##Click '''Add Manual Select'''
+
-
##"Part Title" - enter a descriptive title for this Part.
+
-
###Click '''Add Instructions''' to provide additional instructions to the Part.
+
-
##Click '''Select Questions'''
+
-
##Check the box beside the question(s) you want to add to this Part.
+
-
###To make it easier to locate the question(s) you are looking for, you have the ability to sort the list by Pool, Type and Assessment or Test questions. Sort from the drop-down menu beside each option.
+
-
##Click '''Done'''
+
-
##Click '''Done'''
+
-
#*"Add Random Draw" - this option allows you to randomly choose a specific number of questions from a Question Pool. If you have a Question Pool that contains 45 questions, you can give each student 5 randomly drawn so each student could get entirely different questions.
+
-
##Click '''Add Random Draw'''
+
-
##"Part Title" - enter a descriptive title for this Part.
+
-
###Click '''Add Instructions''' to provide additional instructions to the Part.
+
-
##All Question Pools will be shown, along with the number of questions available (if questions from this pool have already been added to a different part of the assessment, they will not be available for random draw in this Part.), point value and difficulty level. In the "Draw" box, enter the number of questions you want pulled from that Question Pool.
+
-
##Click '''Done'''
+
-
##Click '''Done'''
+
-
 
+
-
== Publish an Assessment in Assessments  ==
+
-
 
+
-
Once you have an assessment with at least one Part and questions, you are ready to determine how you want the assessment to be delivered to the students.
+
-
 
+
-
'''NOTE:''' Once an assessment has been published, you can no longer add, remove, or change questions. The questions are copied from the pool into the assessment, so if you change a question in the Question Pool, the change will not be reflected in the assessment. If you find a problem with a question, want to change the order of the parts, etc., you will have to duplicate the assessment and make the changes in the duplicate. If the original assessment has submissions, even a test drive, you cannot delete it. You can only archive the assessment. You probably want to change the name of the original to include "faulty" in the title so you know not to retrieve and use that assessment from the archive at a later date.
+
-
 
+
-
=== Settings in Assessments  ===
+
-
 
+
-
To edit the settings and publish as assessment:
+
-
 
+
-
#From the Assessments list on the main page of the Assessments tool, click the Publish [[Image:Assessments-not-published.png]]icon to the far right of the Title of the assessment you want to publish.
+
-
##"Title" - you may edit the name of the assessment here.
+
-
##"Type" - displays the assessment type chosen when the assessment was created. It is possible to change it here, but not recommended if you have already added questions since the various types require unique question types.
+
-
##"Open" - this is the date and time that the assessment becomes available for students. If you do not enter anything, the assessment will be available as soon as you publish. Click the calendar [[Image:Assessments-calendar.png]]icon to choose a date and time.
+
-
##"Due" - this is the date and time after which the assessment is considered "late." Click the calendar icon to choose a date and time.
+
-
##"Accept Until" - this is the date and time after which the assessment will no longer be available to students. If you make this the same as the "Due" date and time, late submissions will not be accepted.
+
-
##"Tries" - How many attempts do the students get? Default is that they get one attempt. You may change the number to anything you want, or change the selection to "Unlimited."
+
-
##"Time Limit" - The default is that there is no time limit. If you want to provide a time limit, change the selection to "Timed" and enter the time. Click '''Instructions''' to see the format for entering the time.
+
-
##Make Review Available
+
-
##*"Upon submission" - as soon as students submit the assessment, they can see the review options you have chosen to release.
+
-
##*"Upon release" - the instructor controls when the review options are released to students.
+
-
##*"After date" - you choose a specific date and time for the release of review options. When you select this option, a calendar icon is provided for your use in choosing the release date and time.
+
-
##*"Never" - students do not get to review their assessments.
+
-
##"Show Answer Key &amp; Items Scores" - when the review is released, what aspects do students get to see?
+
-
##*"For all answers" - students see the answer key and score for all answers.
+
-
##*"Only for correct answers" - students only see the answer key and score for questions they got correct.
+
-
##*"Never" - students do not see answer key and score in the assessment submission.
+
-
##*"Show feedback" - default is that students see any feedback you've provided in the questions. Uncheck the box if you do not want feedback revealed.
+
-
##Release Grades
+
-
##*"Automatic release" - by default, the scores are released based upon your choice in the "Make Review Available" option.
+
-
##*"Manual release" - if you choose this option, you will release the scores one-at-a-time within each assessment, or choose "Release evaluated submissions" or "Release all submissions" from the submissions page. This option is good for assessments that contain questions that must be manually graded.
+
-
#Send to Gradebook - if you check this box, a column is automatically created in the gradebook.
+
-
#Anonymous Grading - This option hides the username so the assessment can be evaluated without knowing who submitted the assessment. To restore the student names after grading is complete, come back to settings and uncheck this box.
+
-
#Password - if desired, enter a password that students must enter before they will be granted access to the assessment. This option could heighten security for proctored classrooms if the password is not given out until all participants are gathered in the classroom.
+
-
#Honor Pledge - If you check this box, students will be required to check a box acknowledging the honor pledge before they are allowed to submit their assessment.
+
-
#Hints - if you have provided "hints" during the construction of your questions, you may check this box to show the hints during the delivery of the assessment.
+
-
#Navigation
+
-
#*"Flexible order" - Students are provided with a table of contents which allows them to answer the questions in any order they wish.
+
-
#*"Strict order" - The questions must be answered in the order in which they are delivered. There is no going back to a previous question.
+
-
#Layout
+
-
#*"One question per page" - each question is displayed on its own webpage.
+
-
#*"One part per page" - each Part is displayed on its own webpage.
+
-
#*"All questions on one page" - the entire assessment is displayed on one page.
+
-
#Part Numbering
+
-
#*"Continuous" - questions are numbered sequentially, regardless of how many Parts there are.
+
-
#*"Restart on each part" - each Part starts numbering at 1.
+
-
#Final Message - Provide a final message to students if desired. You might use this to let them know when scores will be released, what they should do after completing the assessment, etc.
+
-
#Click '''Publish'''
+
-
 
+
-
=== Grant Special Access in Assessments  ===
+
-
 
+
-
Assessments allows you to add special access for specific students, for example, to give extra time to special needs students, without having to create a separate assessment for them. You can also use this option to allow a different time-frame or number of tries.
+
-
 
+
-
#Click '''Assessments''' in the left menu bar
+
-
#Beside the assessment to which you want to add special access, click the "grant special access" [[Image:Assessments-special-access.png]]icon at the far right of the screen.
+
-
#Click '''Add'''
+
-
#The names of all participants appear in the box. Select the name(s) to whom you want to grant special access.
+
-
#Provide the Open, Due and Accept Until dates for the user(s) if they are different from the dates of the main assessment.
+
-
#Adjust the Time Limit if desired.
+
-
#Adjust the number of attempts if desired.
+
-
#Provide a password if desired.
+
-
#Click '''Done'''. You will be returned to the "Special Access" list where you see your new access listed.
+
-
 
+
-
When you return to the main list of assessments, you will see that the grant special access icon has changed [[Image:Assessments-access-added.png]]to show that this assessment has special access added.
+
-
 
+
-
==== Edit Special Access  ====
+
-
 
+
-
#Beside the assessment, click the "grant special access" [[Image:Assessments-access-added.png]]icon.
+
-
#Click the hyperlinked name of the user(s) to whom the access has been granted. The edit screen is opened that allows you to make changes.
+
-
#Click '''Return'''
+
-
 
+
-
==== Delete Special Access  ====
+
-
 
+
-
#Beside the assessment, click the "grant special access" [[Image:Assessments-access-added.png]]icon.
+
-
#Check the box beside the special access you want to delete.
+
-
#At the top of the page click '''Delete'''
+
-
#In response to the "Are you sure you want to delete the selected special access?" message, click '''Delete'''.
+
-
#Click '''Done.'''
+
-
 
+
-
== Manage Assessments in Assessments  ==
+
-
 
+
-
Various icons identify the status of assessments in your list.
+
-
 
+
-
*[[Image:Assessments-no-questions.png]]means the assessment has no questions and cannot be published.
+
-
*[[Image:Assessments-live.png]]means the assessment is currently available to students.
+
-
*[[Image:Assessments-ungraded-submissions.png]]means the assessment has submissions that need to be graded.
+
-
 
+
-
=== Unpublish an Assessment in Assessments  ===
+
-
 
+
-
You may wish to unpublish an assessment if you decide you do not want it to be available to students. You cannot make changes to the questions or Parts once it is published, but you can change settings. If you unpublish an assessment that has submissions, you will lose access to those submissions until you republish.
+
-
 
+
-
To unpublish an assessment:
+
-
 
+
-
#Click '''Assessments''' from the left menu bar
+
-
#Check the box beside the assessment(s) you want to unpublish.
+
-
#Click '''Unpublish''' at the top of the list.
+
-
#In response to the "Are you sure you want to unpublish the selected assessments?" message, click '''Unpublish'''
+
-
 
+
-
=== Delete an Assessment in Assessments  ===
+
-
 
+
-
Assessments cannot be deleted if there are any submissions, or even if you have done the "test drive." If the assessment has been accessed, you can only archive to remove it from the list.
+
-
 
+
-
To delete an assessment that has not been accessed:
+
-
 
+
-
#Click '''Assessments''' in the left menu tool bar
+
-
#Check the box beside the assessment(s) you want to delete.
+
-
#Click '''Delete''' at the top of the list.
+
-
#In response to the "Are you sure you want to delete the selected assessments?" message, click '''Delete'''.
+
-
 
+
-
=== Archive an Assessment in Assessments  ===
+
-
 
+
-
Once an assessment has submissions, it cannot be deleted, but can be archived. Archived assessments can be retrieved for future use.
+
-
 
+
-
To archive an assessment:
+
-
 
+
-
#Click '''Assessments''' in the left menu bar
+
-
#Check the box beside the assessment(s) you want to archive.
+
-
#Click '''Archive''' at the top of the list.
+
-
#In response to the "Are you sure you want to archive the selected assessments?" message, click '''Archive'''.
+
-
 
+
-
==== Restore an Archived Assessment in Assessments  ====
+
-
 
+
-
To restore an archived assessment:
+
-
 
+
-
#Click '''Assessments''' in the left menu bar
+
-
#Click '''Restore''' at the top of the list.
+
-
#All archived assessments are listed. Check the box beside the assessment(s) you want to restore.
+
-
#Click '''OK'''
+
-
 
+
-
The assessment is now in the list of available assessment.
+
-
 
+
-
== Manage Student Submissions in Assessments  ==
+
-
 
+
-
Once students begin to take the assessments, you will be able to view their submissions, make edits, comments and grade those questions that require manual grading.
+
-
 
+
-
=== View and Edit Student Submissions in Assessments  ===
+
-
 
+
-
To view the student submissions:
+
-
 
+
-
#Click '''Assessments''' in the left menu bar.
+
-
#Click '''Grading''' at the top of the page.
+
-
#Click the hyperlinked name of the assessment you want to grade.
+
-
#The "Grade Submissions" screen is opened. You will see a list of all students who have access to the assessment, the number of attempts, date and time the assessment was submitted, the auto score and a box for the Final score (empty if there are questions that must be graded manually). There is also a checkbox that shows if the submission has been evaluated and/or released at this point, plus the [[Image:Assessments-special-access.png]]icon to give special access to this student. Click the hyperlinked name of the student whose submission you want to view.
+
-
#On this screen, you see each question, the student's response, the correct response, the points awarded. You may make adjustments to points, provide comments on each question and/or comments on the overall submission.
+
-
#Check the "Mark as '''evaluated''' box if desired. This serves to let you and other graders know that this submission has already been evaluated.
+
-
#If grades are not already released and you are ready to release this student's grade, check the box labeled "'''Release''' grade to submitter."
+
-
#Click '''Done''', or '''Prev''' to see the previous submission in the list, or '''Next''' to see the next submission in the list.
+
-
 
+
-
==== Grade Anonymously  ====
+
-
 
+
-
If you want to grade student scores without knowing who submitted, you will need to set the assessment to anonymous grading.
+
-
 
+
-
#Click '''Assessments''' in the left menu bar.
+
-
#Beside the assessment, click the [[Image:Assessments-published.png]]icon.
+
-
#Under the heading "Anonymous Grading," Check the box beside "Suppress username while grading."
+
-
#Click '''Done'''.
+
-
#You are returned to the list of assessments. At the top of the screen, click '''Grading'''.
+
-
#Click the hyperlinked name of the assessment.
+
-
#Under the "Name" column, you will only see "User" for each submission. Click '''User''' to evaluate as above.
+
-
#Once you have completed grading, you can go back to settings and uncheck the "Suppress username while grading" box to reveal the student names.
+
-
 
+
-
==== Grade by Question  ====
+
-
 
+
-
Rather than grade an entire submission, you may grade by a particular question. This is a good option if you have a faulty question and want to go in and give everyone credit that missed it due to the error.
+
-
 
+
-
#Click '''Assessments''' in the left menu bar.
+
-
#Click '''Grading''' at the top of the screen.
+
-
#Click the hyperlinked name of the assessment you want to grade.
+
-
#Click '''Grade Questions''' at the top of the list.
+
-
#All the questions that were delivered by this assessment are listed. Click the name of the question you want to grade.
+
-
#You will see the question and then a list of all the students who received that question and can edit and make comments on each submission. Click '''Done'''.
+
-
 
+
-
==== View Summary of Data  ====
+
-
 
+
-
Summary of Data provides statistics on each question, showing how many students chose each answer, and what percentage got the answer correct. To view the Summary of Data:
+
-
 
+
-
#Click '''Assessments''' in the left menu bar.
+
-
#Click '''Grading''' at the top of the screen.
+
-
#Click the hyperlinked name of the assessment you want to grade.
+
-
#Click '''Summary of Data''' at the top of the list.
+
-
 
+
-
== Create a Survey in Assessments  ==
+
-
 
+
-
A Survey can be created that will gather anonymous opinions from participants. Create a [[Assessment#Create_a_Question_Pool_in_Assessments|Question Pool]] that contains your Survey Questions before you create the Survey. Survey questions can be created using any question type. As you create each question, you can check the box which designates this question as a survey question, which will remove the option to designate a correct answer. Once you have your questions in a pool, you may create the Survey.
+
-
 
+
-
Creating a Survey is exactly like [[Assessment#Create_an_Assessment_in_Assessments|creating an assessment]] except that you choose "Survey" under "Type."
+
-
Managing Survey submissions is exactly like [[Assessment#Manage_Student_Submissions_in_Assessments|managing assessment submissions]].
+
Survey function has a some limitations (a. if one chooses to view results when survey is in progress it will terminate the survey and it can no longer be used, b. the data cannot be exported) If you have a survey that is critical please use Qualtrics for delivering your surveys.

Latest revision as of 15:54, 27 January 2014

Contents

Overview

There are two online testing tools in e-Learning, Assessments and Tests & Quizzes. Assessments is almost always the best choice. Assessments is easier to use, offers several nice features that are not available in Tests & Quizzes, and performs with far fewer problems than Tests & Quizzes.

Assessments has an easy process for assigning an assessment to special needs students that need added time, but there is no option to assign an assessment to a group. The "special access" option can be used to set up a test for a group if the course and number of groups is small, but would not be practical for a large class with lots of groups. The "special access" process allows you to give different access to various students without having to duplicate the test.

Assessments offers the option to require students to acknowledge the Honor Code before they can submit the assessment.

Question Pools and tests can be imported from Tests & Quizzes into Assessments.

In Tests & Quizzes, Question Pools are associated with the creator's Username, not the course in which the pools were created. So if you are instructor for ABC1234 and CBA4321 and you create five Question Pools in ABC1234, you will also see those five pools when you go to your CBA4321 course. This is helpful in that you always have access to your Question Pools, but it requires you to pay attention to naming conventions. You would not want to name a Question Pool "Exam 1." It also presents problems because other instructors, TAs, and help desk staff cannot access your pools to assist you in test creation.

In Tests & Quizzes, if you insert images into the Content Editor in the question body or in the answers, those images will be broken when the test is imported into future semesters. You can add the image as an attachment and it will appear at the bottom of the text. Students do not have to click an attachment to open it. Assessments has a more reliable way to insert images, but requires some pre-planning if you have a large number of images (more than ~100) that you will be using in the test.

NOTE: Currently, the "Survey" option in Assessments isn't working correctly. Do not use Assessments for creating surveys. Qualtrics is your best tool for creating surveys.

Create and Manage Question Pools in Assessments

Video.jpg Video Tutorial

You do not have to use Question Pools, but they are a good resource for building, maintaining and storing questions that are available to be used in building tests. They also allow for building an assessment that randomly pulls questions from a pool so that two students taking the same exam will be presented with different questions. Because Question Pools contain questions with the same difficulty level, it is easy to create a test that will, for example, deliver 10 randomly drawn easy questions and 5 randomly drawn difficult questions.

Create a Question Pool in Assessments

From within the course where you want to create a Question Pool:

  1. Click Assessments in the left menu bar.
  2. At the top of the Assessments page, click Question Pools
  3. Click Add Pool
  4. "Pool Title" - enter a descriptive title for this Question Pool
  5. "Description" - you may enter a description of this pool if desired. The Content Editor is available if you want to format this text.
  6. "Point Value" - you must enter a Point Value that will be applied to every question in this Question Pool. It is not possible to have questions with different point values in the same Question Pool, though you may override the point value once the questions are in an assessment.
  7. "Difficulty" - select the difficulty level of the questions in this Question Pool. It is not possible to have questions with different difficulty levels in the same Question Pool.
  8. Click Done

Add Questions to a Question Pool in Assessments

When the Question Pool is created, you are taken to a screen that allows questions to be added. If you want to add questions to a Question Pool that was previously created, access this screen by clicking Assessments > Question Pools > Hyperlinked Name of Question Pool.

  1. Click Add Question
  2. Select Question Type. The default is set for Multiple Choice. If you want a different question type, select the radio button beside the type of question you want.
    • Complete the question creation screen. Each question type provides instructions for creating that type of question on the question creation screen.
  3. Click Done or Add Another

NOTE: Inserting images is simple using the insert image icon in the content editor. Images used in Assessments are NOT stored in Resources, but in the Assessments tool own file storage system. Once images are in the Assessments file storage, they cannot be removed or moved into a different folder. This prevents breaking links in the questions, but means you need to be very careful to upload the correct image into the correct folder.

Create a Question Pool by using "Copy and Paste" from a Properly Formatted Text Document in Assessments

You may import a properly formatted text document of questions. This process creates a new Question Pool.

  1. Using Wordpad or other plain text editor, enter tests questions using the proper format:
    • NOTE: The recommendation to use Wordpad or plain text editor is due to the fact that new versions of MS Word put in lots of formatting by default - spacing, indenting for example. If you are comfortable enough with Word to know how to turn off the default formatting, feel free to use it. If you copy from Word into a plain text editor, make sure you scan the text for extraneous spaces or gaps in text that could cause problems in the question creation process. We also recommend that you test drive the completed assessment before releasing it to students.
  2. From within the Question Pool screen (Assessments > Question Pools) click Import
  3. Select "Paste Questions & Import"
  4. Copy the text from your document and paste it in the box provided in e-Learning. Make sure that there is a space between each question.
  5. Click OK

If the import was successful a new question pool was created. The newly created Question Pool will be untitled and not have points associated with it. The difficulty level will be at the default, "Level 3." To edit the Question Pool details, click on the hyperlinked name of the Question Pool, then click Edit Pool Properties. On this screen you are able to rename the Question Pool, provide a Description if desired, enter the Point Value and adjust the Difficulty Level.

Import a Question Pool from Tests & Quizzes

If you have been using Tests & Quizzes but would like to move to the Assessments tool, it is fairly simple to import Question Pools and tests. Go here for instructions.

Delete, Copy and Move Questions Within Question Pools in Assessments

Delete Questions from Question Pools in Assessments

NOTE: When you create a test using questions in Question Pools, the questions are replicated from the pool into the test. So anything you do to the questions in the pools will not affect the questions in the test.

  1. Open the Question Pool (Assessments > Question Pools > Click the hyperlinked name of the Question Pool) that contains the question(s) you want to delete.
  2. Check the box next to the question(s) you want to remove.
  3. Click Delete
  4. In response to the "Are you sure you want to delete the selected questions?" click Delete.
Copy Questions from one Question Pool to Another in Assessments

If you copy a question to a different pool, the question will then appear in both question pools. Remember that the question will now have the point value and difficulty level of its new pool.

  1. Open the Question Pool (Assessments > Question Pools > Click the hyperlinked name of the Question Pool) that contains the question(s) you want to copy to a different pool.
  2. Check the box next to the question(s) you want to copy.
  3. Click Copy to Pool
  4. A screen is opened showing all available pools. Select the pool to which you want to copy the question.
  5. Click OK.
Move Questions from one Question Pool to Another in Assessments

If you move a question to a different pool, the question will be removed from the original pool and placed in the new pool.

  1. Open the Question Pool (Assessments > Question Pools > Click the hyperlinked name of the Question Pool) that contains the question(s) you want to move to a different pool.
  2. Check the box next to the question(s) you want to move.
  3. Click Move to Pool
  4. A screen is opened showing all available pools. Select the pool to which you want to move the question.
  5. Click OK

Question Types in Assessments

There are several types of questions available in Assessments. When you create each of these question types, you will be given instructions on how to compose the question if it is not obvious. Below is a brief description of each type and when you might want to use it.

Multiple Choice

There are two types of Multiple Choice questions:

Multiple Choice questions allow for the answers to be randomized each time the question is displayed to a student so that the correct answer is a different option each time. You can also require the students to provide a rationale for their answer so that you can verify that the student knows the answer and isn't just guessing.

True/False

True/False questions ask the student to determine if a statement is true or false.

Essay

Essay questions provide two ways for students to submit their answers.

The instructor decides to allow one or both of these options. This question type must be manually graded.

Fill In The Blank

Fill in the Blank questions ask the student to insert a word or words into the question text to complete a sentence or paragraph. While this question type is automatically graded, the student's entry must match exactly the option(s) provided by the instructor. There is some flexibility in providing acceptable answers, matching case, etc., but the best practice is to only use this type of question with totally unambiguous test questions.

Matching

Matching type question require that the student matches one term, phrase or image to another. For example, you could insert images of plants and the student would have to choose the name of the plant from a list provided.

Likert Scale

This question type is only available as a Survey question. The participants answer this question using a scale chosen by the instructor, such as: "On a scale of 1-10, what do you think of . . .?"

Task

This question type is exactly like Essay, except that you have the added option to say "No answer is expected for this question." You would use this option if the student was going to be graded on, for example, an in-class performance. This is comparable to the "non-electronic" submission feature in Assignments. This question type must be manually graded.

Create an Assessment in Assessments

Video.jpg Video Tutorial

You may construct an assessment using questions pulled randomly from the Question Pools, questions specifically chosen from the Question Pools, or questions that you create directly in the assessment. Questions created within the assessment will automatically create a corresponding pool with zero points and the default "3" difficulty level. It can be edited at any time.

  1. Click Assessments
  2. You are taken to the main Assessments page. Click Add.
  3. Select from one of three types of assessments:
    • Test - a tool to evaluate student knowledge.
    • Assignment - this option behaves exactly like a Test, but it gives a different icon Assessment-assignment.pngbeside the name of the assessment in the assessment list.
    • Survey - the survey is intended to gather opinions from anonymous users. There are no correct answers or points awarded. NOTE: Surveys are designed to guarantee anonymity. You will not be able to see individual responses, only an overall report of answers chosen. Once you have set an assessment to be a survey you cannot change it back to a test or assignment. If you want to give a survey, your best option is to use Qualtrics.
  4. "Title" - enter a descriptive title for this assessment
  5. Click Edit Instructions if you want to give the students additional instructions. By default, the assessment will provide information such as dates available, time limit, attempts allowed, how to navigate through the test, etc.
  6. Click Manage Parts if you want to add multiple parts to the test. For example, you might have an exam with three parts - one consisting of questions from Chapter 1 of the textbook, another with quetsions from Chapter 2, and another from Chapter 3. You might have a Part with all easy questions and another part with difficult questions. Or you might have a part with all Multiple Choice questions and another part with Essay questions.
    1. Click Edit Instructions if you want to provide instructions for this Part.
    2. Click Add as many times as you need Parts.
    3. Title the Parts and adjust the order using the number drop-down menus beside each Part.
      • Check the box under the "Shuffle" category if you want the questions in this Part to be shuffled each time they are delivered to the students. This would only be applicable if you are not using randomly drawn questions from a Question Pool.
    4. Click Done.

You will notice that your parts will have the yellow triangle icon until you add questions. This is simply an alert to let you know there are no questions yet.

Add Questions to an Assessment in Assessments

You may add questions directly to the Assessment or to the Parts if you created Parts. From the "Edit Assessment" screen:

  1. Click Add to type a question.
    1. Under "For Part" select the Part where you want this question to go if it is not the current one. Notice that you can also add a New Part here.
    2. Choose the Question Type and create the question according to the instructions given.
  2. Click Select to choose from among all the questions in your Question Pools.
    1. Under "For Part" select the Part where you want these questions to go if it is not the current one. Notice that you can also add a New Part here.
    2. By Default, the screen shows all questions, but you can choose to show only one pool at a time from the "Pool:" drop-down menu. You can also sort by question type using the first of the two "Type:" drop-down menus. The second drop-down menu sorts by Survey questions versus assessment questions. Check the box beside the question(s) you want to add to the Part or assessment.
    3. Click Done.
  3. Click Draw to randomly draw a specific number of questions from a pool or pools.
    1. Under "For Part" select the Part where you want these questions to go if it is not the current one. Notice that you can also add a New Part here.
    2. Each pool is listed, including the description (if provided), the number of questions in the pool, the Point value of the pool, and the Difficulty level of the pool. In the "Draw" box beside each pool name, enter the number of questions you would like to have pulled from the pool. Leave the box blank if you do not want questions pulled from that pool.
    3. Click Done. You are returned to the "Edit Assessment" screen.

Publish an Assessment in Assessments

Video.jpgVideo Tutorial

Once you have an assessment with at least one Part and questions, you are ready to determine how you want the assessment to be delivered to the students.

NOTE: Once an assessment has been published, you can no longer add or removed questions. You may edit or reorder the questions and parts, but not remove or add. The questions are copied from the pool into the assessment, so if you edit a question in the Question Pool, the change will not be reflected in the assessment. You must edit the question in the assessment as well as in the Pool.

Settings in Assessments

To edit the settings and publish an assessment:

  1. From the Assessments list on the main page of the Assessments tool, click the Publish Assessments-not-published.pngicon to the far right of the assessment you want to publish.
    1. "Title" - you may edit the name of the assessment here.
    2. "Type" - displays the assessment type chosen when the assessment was created. It is possible to change it here.
    3. "Points" - By default this is checked and the system assumes that if you are giving a test, it is worth points. If you uncheck this box, the option to send the grades to the Gradebook(2) disappears.
    4. "Open" - this is the date and time that the assessment becomes available for students. If you do not enter anything, the assessment will be available as soon as you publish. Click the calendar Assessments-calendar.pngicon to choose a date and time. Set the time first and then click on the date.
    5. "Due" - this is the date and time after which the assessment is considered "late." Click the calendar icon to choose a date and time. Set the time first and then click on the date.
    6. "Accept Until" - this is the date and time after which the assessment will no longer be available to students. If you leave this blank, or make it the same as the "Due" date and time, late submissions will not be accepted. An example of how this would be used is if your students are allowed 30 minutes to take the test and the Due Date is 3pm today. A student who logs in to begin the test at 2:55pm will only get 5 minutes to take the test. If you make the "Accept Until" date as today at 3:30pm, a student beginning the test at 2:55 will still have the full 30 minutes to take the test. It will be marked "Late" since it will be submitted after the Due Date is passed.
    7. "Tries" - How many attempts do the students get? Default is that they get one attempt. You may change the number to anything you want, or change the selection to "Unlimited."
    8. "Time Limit" - The default is that there is no time limit. If you want to provide a time limit, change the selection to "Timed" and enter the time. Click Instructions to see the format for entering the time.
    9. Make Review Available
      • "Upon submission" - as soon as students submit the assessment, they can see the review options you have chosen to release.
      • "Upon release" - the instructor controls when the review options are released to students.
      • "After date" - you choose a specific date and time for the release of review options. When you select this option, a calendar icon is provided for your use in choosing the release date and time. Enter the time first, then click the date.
      • "Never" - students do not get to review their assessments.
    10. "Show Answer Key & Items Scores" - when the review is released, what aspects do students get to see?
      • "For all answers" - students see the answer key and score for all answers.
      • "Only for correct answers" - students only see the answer key and score for questions they got correct.
      • "Never" - students do not see answer key and score in the assessment submission.
      • "Show feedback" - default is that students see any feedback you've provided in the questions. Uncheck the box if you do not want feedback revealed.
    11. Release Grades
      • "Automatic release" - by default, the scores are released based upon your choice in the "Make Review Available" option.
      • "Manual release" - if you choose this option, you will release the scores one-at-a-time within each assessment, or choose "Release evaluated submissions" or "Release all submissions" from the submissions page. This option is good for assessments that contain questions that must be manually graded.
  2. "Model Answer" - if you added "Model Answers" in your questions, you may show them for released submissions in review.
  3. Send to Gradebook - if you check this box, a column is automatically created in the Gradebook(2). Data in the gradebook column cannot be edited within the Gradebook(2). All grade edits must be done within the Assessments tool.
  4. Anonymous Grading - This option hides the username so the assessment can be evaluated without knowing who submitted the assessment. To restore the student names after grading is complete, come back to settings and uncheck this box.
  5. Password - if desired, enter a password that students must enter before they will be granted access to the assessment. This option could heighten security for proctored classrooms if the password is not given out until all participants are gathered in the classroom.
  6. Require Locked Browser - The Locked Browser is an added security feature which completely disables all aspects of the computer except for those needed to access, take and submit the test. Students may not go to other websites, open files, open other applications, copy or print the screen. If a student tries to access a LockDown assessment in a traditional browser, she/he will be blocked from proceeding. Students that do not have the browser installed on their computer when they try to access the test will be given | a link to download the browser. (The LockDown browser is installed on computers in computer labs on campus.) Students install the browser which automatically directs to the e-Learning log-in page. They are unable to navigate to any other page. They login to e-Learning and begin their test. The only way to get out of the Lockdown browser is to submit the test.

NOTE: You must choose "Force Completion" (see below) in addition to the "Require Locked Browser" option if you do not want students to be able to exit the test. Because the Assessments tool offers the "continue later" button, students can use that to leave the test and come back later. The timer will continue to count down, but students can log back in and continue as long as there is time left on the clock. Essentially, the LockDown browser is ineffective without the additional option, "Force Completion." Once Force Completion has been selected, the "continue later" button is removed from the test and the only way to get out of the LockDown browser is to submit the test. The student could shut down the computer, but this action will submit the student's test, prohibiting the student from returning to the test.

    1. None - no lockdown browser is required.
    2. Respondus LockDown Browser - Students can only take the test within the LockDown browser.
    3. Exit Password (optional) - The password is not functional at this time.
    4. Force Completion - If this option is selected, the only way to leave the test or the browser is to submit the test. Checking this box removes the "Continue Later" button from the assessment. If you do not check this option, students may leave the test and come back to it at will, as long as there is time left on the clock.

NOTE: If you intend to use the LockDown browser, we highly recommend that you give students a "practice" test that will allow them to download the browser and try out this technology PRIOR to having to use it for a graded quiz or exam. You can make a test with one question on it, such as "Did you successfully install the LockDown Browser?" Make the test have a time limit of 30 minutes and provide multiple attempts so that if students encounter difficulties with the process, they get another attempt. Direct students with technical difficulties to the UF Computing Help Desk at 352.392.4357.

  1. Honor Pledge - If you check this box, students will be required to check a box acknowledging the honor pledge before they are allowed to begin their assessment.
  2. Hints - if you have provided "hints" during the construction of your questions, you may check this box to show the hints during the delivery of the assessment.
  3. Navigation
    • "Flexible order" - Students are provided with a table of contents which allows them to answer the questions in any order they wish.
    • "Strict order" - The questions must be answered in the order in which they are delivered. There is no going back to a previous question.
  4. Layout
    • "One question per page" - each question is displayed on its own webpage. This option is highly recommended! Every time students move from one question to the next, the "Save" is activated. They can access all questions from the Table of Contents.
    • "One part per page" - each Part is displayed on its own webpage. Use this only if your parts are small (<5 questions) to lessen the possibility of lost answers.
    • "All questions on one page" - the entire assessment is displayed on one page. This option is NOT recommended. If students lose internet connection they could lose answers.
  5. Part Numbering
    • "Continuous" - questions are numbered sequentially, regardless of how many Parts there are.
    • "Restart on each part" - each Part starts numbering at 1.
  6. Final Message - Provide a final message to students if desired. You might use this to let them know when scores will be released, what they should do after completing the assessment, etc.
  7. Click Publish

Grant Special Access in Assessments

Assessments allows you to add special access for specific students, for example, to give extra time to special needs students, without having to create a separate assessment for them. You can also use this option to allow a different time-frame or number of tries.

  1. Click Assessments in the left menu bar
  2. Beside the assessment to which you want to add special access, click the "grant special access" Assessments-special-access.pngicon at the far right of the screen.
  3. Click Add
  4. The names of all participants appear in the box. Select the name(s) to whom you want to grant special access.
  5. Provide the Open, Due and Accept Until dates for the user(s) if they are different from the dates of the main assessment.
  6. Adjust the Time Limit if desired.
  7. Adjust the number of attempts if desired.
  8. Provide a password if desired.
  9. Click Done. You will be returned to the "Special Access" list where you see your new access listed.

When you return to the main list of assessments, you will see that the grant special access icon has changed Assessments-access-added.pngto show that this assessment has special access added.

Edit Special Access

  1. Beside the assessment, click the "grant special access" Assessments-access-added.pngicon.
  2. Click the hyperlinked name of the user(s) to whom the access has been granted. The edit screen is opened that allows you to make changes.
  3. Click Return

Delete Special Access

  1. Beside the assessment, click the "grant special access" Assessments-access-added.pngicon.
  2. Check the box beside the special access you want to delete.
  3. At the top of the page click Delete
  4. In response to the "Are you sure you want to delete the selected special access?" message, click Delete.
  5. Click Done.

Edit a Published Assessment in Assessments

If you discover that there is a faulty question in a live assessment, you may edit the question. The system will automatically adjust grades for submitted tests to reflect the edit. While you may edit any question in the test, even those randomly drawn from a Question Pool, you may not add or remove questions or parts from the test. If you discover a question that needs to be removed, you can change its point value to zero to nullify the question. Remember that questions drawn from a Question Pool are copied from the Pool into the assessment. If you edit the question in the Question Pool, it will have no affect on the published assessment. The edits you make in a published assessment will have no affect on the question in the Question Pool.

Edit a Question in a Published Assessment in Assessments

From the main Assessments page:

  1. Click the hyperlinked name of the Assessment. A screen opens that shows all Parts and all questions. If the questions are drawn randomly from a Question Pool, you will see Random Draw instead of the question text. Directions are below for editing those questions.

Edit the Point Value of a Question

There is a box to the right of each question that reveals the point value. Edit the point value and click Done.

Edit the Text of a Question

  1. Click the hyperlinked question text. The edit screen opens that allows you to change the text of the question or answers, add more answers, remove answers, add feedback or hints.
  2. Make your changes and click Done

Edit a Question Randomly Drawn from a Question Pool in Assessments

Remember that questions drawn from a Question Pool are copied from the Pool into the assessment. If you edit the question in the Question Pool, it will have no affect on the published assessment. The edits you make in the published assessment will have no affect on the question in the Question Pool.

  1. Click the hyperlinked name of the Question Pool
  2. Click the hyperlinked question text. The edit screen opens that allows you to change the text of the question or answers, add more answers, remove answers, add feedback or hints.
  3. Make your changes and click Done
  4. Click Return

Manage Assessments in Assessments

Various icons identify the status of assessments in your list.

Unpublish an Assessment in Assessments

You may wish to unpublish an assessment if you decide you do not want it to be available to students. If you unpublish an assessment that has submissions, you will lose access to those submissions until you republish.

To unpublish an assessment:

  1. Click Assessments from the left menu bar
  2. Check the box beside the assessment(s) you want to unpublish.
  3. Click Unpublish at the top of the list.
  4. In response to the "Are you sure you want to unpublish the selected assessments?" message, click Unpublish

Delete an Assessment in Assessments

Assessments cannot be deleted if there are any submissions, or even if you have done the "test drive." If the assessment has been accessed, you can only archive to remove it from the list.

To delete an assessment that has not been accessed:

  1. Click Assessments in the left menu tool bar
  2. Check the box beside the assessment(s) you want to delete.
  3. Click Delete at the top of the list.
  4. In response to the "Are you sure you want to delete the selected assessments?" message, click Delete.

Archive an Assessment in Assessments

Once an assessment has submissions, it cannot be deleted, but can be archived. Archived assessments can be retrieved for future use.

To archive an assessment:

  1. Click Assessments in the left menu bar
  2. Check the box beside the assessment(s) you want to archive.
  3. Click Archive at the top of the list.
  4. In response to the "Are you sure you want to archive the selected assessments?" message, click Archive.

Restore an Archived Assessment in Assessments

To restore an archived assessment:

  1. Click Assessments in the left menu bar
  2. Click Restore at the top of the list.
  3. All archived assessments are listed. Check the box beside the assessment(s) you want to restore.
  4. Click OK

The assessment is now in the list of available assessment.

Manage Student Submissions in Assessments

Video.jpgVideo Tutorial

Once students begin to take the assessments, you will be able to view their submissions, add comments and grade those questions that require manual grading.

View and Edit Student Submissions in Assessments

To view the student submissions:

  1. Click Assessments in the left menu bar.
  2. Click Grading at the top of the page.
  3. Click the hyperlinked name of the assessment you want to grade.
  4. The "Grade Submissions" screen is opened. You will see a list of all students who have access to the assessment, the number of attempts, date and time the assessment was submitted, the auto score and a box for the Final score (empty if there are questions that must be graded manually). There is also a checkbox that shows if the submission has been evaluated and/or released at this point, plus the Assessments-special-access.pngicon to give special access to this student. Click the hyperlinked name of the student whose submission you want to view.
  5. On this screen, you see each question, the student's response, the correct response, the points awarded. You may make adjustments to points, provide comments on each question and/or comments on the overall submission.
  6. Check the "Mark as evaluated box if desired. This serves to let you and other graders know that this submission has already been evaluated.
  7. If grades are not already released and you are ready to release this student's grade, check the box labeled "Release grade to submitter."
  8. Click Done, or Prev to see the previous submission in the list, or Next to see the next submission in the list.

Grade Anonymously

If you want to grade student scores without knowing who submitted, you will need to set the assessment to anonymous grading.

  1. Click Assessments in the left menu bar.
  2. Beside the assessment, click the Assessments-published.pngicon.
  3. Under the heading "Anonymous Grading," Check the box beside "Suppress username while grading."
  4. Click Done.
  5. You are returned to the list of assessments. At the top of the screen, click Grading.
  6. Click the hyperlinked name of the assessment.
  7. Under the "Name" column, you will only see "User" for each submission. Click User to evaluate as above.
  8. Once you have completed grading, you can go back to settings and uncheck the "Suppress username while grading" box to reveal the student names.

Grade by Question

Rather than grade an entire submission, you may grade by a particular question.

  1. Click Assessments in the left menu bar.
  2. Click Grading at the top of the screen.
  3. Click the hyperlinked name of the assessment you want to grade.
  4. Click Grade Questions at the top of the list.
  5. All the questions that were delivered by this assessment are listed. Click the name of the question you want to grade.
  6. You will see the question and then a list of all the students who received that question and can edit and make comments on each submission. Click Done.

View Summary of Data

Summary of Data provides statistics on each question, showing how many students chose each answer, and what percentage got the answer correct. To view the Summary of Data:

  1. Click Assessments in the left menu bar.
  2. Click Grading at the top of the screen.
  3. Click the hyperlinked name of the assessment you want to grade.
  4. Click Summary of Data at the top of the list.

Create a Survey in Assessments

Survey function has a some limitations (a. if one chooses to view results when survey is in progress it will terminate the survey and it can no longer be used, b. the data cannot be exported) If you have a survey that is critical please use Qualtrics for delivering your surveys.

Personal tools
Namespaces
Variants
Actions
Navigation
Toolbox