Picture of CA Edington
Quizzes
by CA Edington - Sunday, 22 October 2006, 09:20 AM
 
It was nice to see a lot of you at the JALT CALL Conference yesterday.  I got really inspired by Peter's presentations to do even more with my classes that are on Moodle.

For now, I have 3 questions concerning quizzes.  The first two concern a quiz on where to put the quotation marks in a sentence.

(1) When the students typed quotation marks, their answers showed up with a slash in front of the quotation marks --> /"  The same thing happened when I tried typing answers.  Does this have something to do with whether smart quotes are turned on or off?

(2) In some of the answers, part of the answer (the name of a book) was supposed to be in italics.  When the students were doing this exercise on paper, in the Dark Ages, they simply underlined any titles that should be in italics.  Is it possible for students to put part of the answer in italics?

(3) For short answer and multiple choice questions, the feedback I write shows up, and students can see the correct answer once I turn that on.  However, with the Cloze questions, the feedback doesn't show up and the students can't see the correct answer - only green for correct answers or red for incorrect answers.  Does anyone have experience with Cloze questions who knows how to get the feedback and the correct answers to appear?

And, 4th, if anyone answers this, why aren't you outside enjoying the beautiful, if chilly, fall weather, as I intend to do in a little bit?

CA



Picture of Don Hinkelman
Re: Quizzes
by Don Hinkelman - Sunday, 22 October 2006, 06:11 PM
 
Hi CA,

Yes, many thanks to Peter!  Our moodle trainer from Hakodate.  I heard his parents are in town and they were touring the Pioneer Village while Peter was doing the workshops.  smile

1.  I don't know about this one.  Anyone else know?
2.  click the italics button in the toolbar just above this input box. Like this italic!  Or underline. Or bold.  Or strikeout.  Or colors.  If you cannot see the toolbar at all, it is because you are using Safari, which cannot handle the toolbar in moodle.  You have to switch to Firefox. Sorry.  sad
3.  Sorry, I haven't tried cloze exercises.  Anyone else?
4.  It's actually cold and rainy now.  sleepy
Picture of CA Edington
Re: Quizzes
by CA Edington - Sunday, 22 October 2006, 08:05 PM
 
Thanks for your response, Don.  It's actually not a browser thing.  At home, I used Safari for less than a month before switching to Firefox, I think as a result of what I learned at last year's CALL Conference.  The computers the students are using are in the classroom, so they're using Explorer.

There's no toolbar above the input box for answers to questions on the quizzes.  Is that because I'm using a rather ancient version of Moodle?  (I don't know which version because I'm not sure where to check.)

CA

Don H. wrote:
2.  click the italics button in the toolbar just above this input box. Like this italic!  Or underline. Or bold.  Or strikeout.  Or colors.  If you cannot see the toolbar at all, it is because you are using Safari, which cannot handle the toolbar in moodle.  You have to switch to Firefox. Sorry.  sad
Picture of Don Hinkelman
Re: Quizzes
by Don Hinkelman - Sunday, 22 October 2006, 09:09 PM
 
Sorry, I assumed that for open answers you were using a Forum or a Journal, which have the HTML toolbar.  I would definitely use a Journal, not a Quiz for open answers, especially ones where they have to format their answers.
Picture of CA Edington
Re: Quizzes
by CA Edington - Sunday, 22 October 2006, 10:14 PM
 
The reason for using a Quiz was that so students could get immediate feedback after submitting their answers.  I may have to go another way, though, as you suggested.

CA

Picture of Eric Hagley
Re: Quizzes
by Eric Hagley - Monday, 23 October 2006, 09:48 AM
 
For feedback on the cloze, students have to "toggle" above the red or green part. Toggle means move your cursor / mouse above the box where you have written the answer slowly. The feedback appears in a kind of pop up window.
As to immediate feedback after students take a quiz, if it is a cloze exercise then yes you can give semi immediate feedback, but until you check every answer you cannot be sure that the students' answers are really wrong or right. I have a lot of students who put a space at the end of their answers - even though the answer is right, because there is an extra space there, it is read as wrong!
As to italics etc, if you set rules such as itstart word in italics itends (for italics start and italics end, undstart   undend for underline, etc) you could get around it, but it does seem a little strange. For answers that require a written response, the quiz module isn't so good!
Hope this helps,
Eric
Picture of CA Edington
Re: Quizzes
by CA Edington - Monday, 23 October 2006, 06:16 PM
 
Thank you for your thorough answer, Eric. 

I tried to "toggle" above the Cloze answers, but it must be a means of feedback that was added to versions later than the one I'm using.

As for the italics, I think the easiest way is to have students type a slash [/] before and after titles that should be in italics.  The main thing is that they can see the correct answer after they submit the quiz to check again their own answer.

Don said that the correct answers don't appear in green in later versions?  That's unfortunate.  sad  Don hopes that it gets changed back, as do I.

I woud appreciate hearing, either on the Forum or in person, from anyone else who is using quizzes extensively, as I am for my course on To Kill a Mockingbird.

Gratefully yours,
CA

P.S.) For some reason I'm not able to use the formatting bar with these messages, which is why To Kill a Mockingbird is not in italics, and my message is not in shocking pink.  I'm using Firefox on an iBook G4.  ???

Picture of Don Hinkelman
Re: Quizzes
by Don Hinkelman - Monday, 23 October 2006, 11:07 PM
 
How about this... To Kill a Mockingbird
And this... and my message is in shocking pink.

The formatting bar should work for you.  Don't know why it wouldn't. 

Earlier you explained to me the reason for using Short Answer type questions in the Quiz module as opposed to a manually graded exercise such as Journal or Assignment.  It was as a training exercise rather than a testing assessment.  Students try to make an answer, then immediately see a model answer because the teacher reveals the answer immediately.  I really like that mode of the Quiz module, and that style of pedagogy.
Picture of Peter Ruthven-Stuart
Re: Quizzes
by Peter Ruthven-Stuart - Sunday, 29 October 2006, 11:29 PM
 
Hello CA

Having enjoyed the autumn leaves I am now ready to answer your 3 questions:

(1) When the students typed quotation marks, their answers showed up with a slash in front of the quotation marks --> /"  The same thing happened when I tried typing answers.  Does this have something to do with whether smart quotes are turned on or off?

I used to have this problem, but with more recent versions of Moodle quotation marks now work in the Short-Answer type questions, and kind of work in the SHORTANSWER of the Cloze type question. To demonstrate the various question types I have just made a course in this Moodle called "Course for Quizzes", and made you a teacher of this course. Here's the URL for the course:
http://englishforum.sgu.ac.jp/moodle/course/view.php?id=49

You'll see that I have created just one quiz with 3 questions; a Short-Answer, a Cloze with 2 SHORTANSWER questions, and a Cloze with one SHORTANSWER that contains an italicised word as the correct answer. Quotation marks do work, although not perfectly in the SHORTANSWER Cloze. Have a look, and even edit the questions if you wish. Although, if you do edit a question, it's best to save it as a new question.

(2) In some of the answers, part of the answer (the name of a book) was supposed to be in italics. When the students were doing this exercise on paper, in the Dark Ages, they simply underlined any titles that should be in italics.  Is it possible for students to put part of the answer in italics?

In both the Cloze type questions and Short-Answer questions it is possible to require students to type the the HTML tags for italics, which are < i > and < / i > on either side of the word or words to be italicised. Note, that I have put spaces in the tags above so that this Moodle doesn't think the tags are real and so italicise the 'and'.

However, just because it is possible doesn't mean you want to do it. The only occasion when I would ask students to format words in a quiz - i.e. type HTML, is if I were teaching students how to write HTML. I think you'd be creating to many problems for yourself if you required students to use HTML tags, since the Quiz module is not at all forgiving of even minor errors. As Eric points out, a space added after a one word answer will be treated as incorrect. So if text formatting is important, as Don suggests, I'd use a different module.

That said, there are two features of the Quiz module that can make the grading less strict, or at least more versatile. The first feature is the asterisk wild card '*'. So, for example, if the correct answer is Moodle, and you write *Moodle* as the correct answer when making a quiz, students will be graded as correct as long as the word Moodle appears somewhere in their answer. The second feature, which is new and I am not familiar with, is 'Regular Expressions analysis'. You can read about this here:
http://docs.moodle.org/en/Short_answer_analysis

(3) For short answer and multiple choice questions, the feedback I write shows up, and students can see the correct answer once I turn that on.  However, with the Cloze questions, the feedback doesn't show up and the students can't see the correct answer - only green for correct answers or red for incorrect answers.  Does anyone have experience with Cloze questions who knows how to get the feedback and the correct answers to appear?

Again, have a look at the examples I have made:
http://englishforum.sgu.ac.jp/moodle/mod/quiz/edit.php
The feedback works as Eric describes. Students need to move their cursor over their answers once they have submitted the quiz, or in the case of adaptive mode, submitted an individual question. When a cursor is moved over a text box, the feedback will pop-up. The text boxes of wrong  answers are coloured a pinkish-red, partially correct answers are not coloured at all, and correct answers are coloured green. These two feedback features (popup feedback messages and coloured textboxes) have not always worked in previous versions of Moodle. However, hopefully you can see them working in the examples that I have made. By the way, at the time of writing this reply, this Moodle system is version 1.6.2+

Hope this helps.

Picture of CA Edington
Re: Quizzes
by CA Edington - Monday, 30 October 2006, 08:14 PM
 
Peter - Thanks so much for your very thorough answer.  Today I had only a little time to check the site and the quiz that you set up. It was especially great to see the feedback features of the popup messages and colored textboxes for the Cloze as well as the other questions.

Since I haven't used version 1.6.2, there was a lot that was new to me just in terms of navigating the site, for example, how the quizzes themselves are set up.  I'm looking forward to playing around with the questions and deciding on what would be easiest for the students.  It may take a while, but I'll report back when I do.

I appreciate your thoroughness and generosity, both in making this site available and in your presentations at JALT CALL.  Your students are truly fortunate.  (Actually, the students of everyone on this forum are fortunate!)

CA

Picture of CA Edington
Re: Quizzes
by CA Edington - Wednesday, 4 April 2007, 09:34 AM
 
I think I may have finally mastered (or at least succeeded to some extent) in writing a Cloze question for Moodle quizzes.  See example at: <http://englishforum.sgu.ac.jp/moodle/mod/quiz/attempt.php?q=51>.  (It helps if you've read To Kill a Mockingbird.)

Since I'm now using a higher version of Moodle (*1.7?), I'm able to see what you mean, Eric and Peter, about the feedback features.

However, once students have attempted the quiz, there's a message that "You can no longer add or remove questions."  (See <http://englishforum.sgu.ac.jp/moodle/mod/quiz/edit.php?quizid=51>.)  What do I do if I want to add a new question?  Is it impossible?

Appreciate any feedback,
CA

*Thanks to NorthSkyHost Bob Palmer for hosting my new Moodle site (under construction) and to Bob Gettings and Narumi Sekiya for getting all the classes, including the quizzes, from my former site transferred to the new site.
Picture of Peter Ruthven-Stuart
Re: Quizzes
by Peter Ruthven-Stuart - Wednesday, 4 April 2007, 11:36 AM
 
Hello CA,

The message you saw: "You can no longer add or remove questions.", appears in the editing view of all quizzes once students have attempted the quiz. In the past, it was possible to add and remove questions from quizzes even once students had attempted them. This broke the the quizzes and made students angry. So, we teachers can now only edit existing questions once the quiz in which the question exists has been attempted. If you do edit a question in such a way that the answer changes, remember to click on the 'regrade' tab in the quiz activity.

If you really need to REMOVE a question from an already attempted quiz there are 2 solutions:
  1. change the score for the 'bad' question to zero, add a message to the question that says 'do not bother with this question', and click on the regrade tab
  2. delete all students' attempts, REMOVE the offending question, and then tell students - who'll probably be a little angry - to do the quiz again
If you need to ADD a question to an already attempted quiz there are 2 solutions:
  1. create a new quiz containing just the new question(s)
  2. delete all students' attempts, ADD the new questions, and then tell students - who'll probably be a little angry - to do the quiz again
Solution 2 in both situations is only really recommended when just a few students have attempted the quiz.
Picture of Peter Ruthven-Stuart
Re: Quizzes
by Peter Ruthven-Stuart - Wednesday, 4 April 2007, 12:48 PM
 
Hello again,

I have just had a look at your cloze question. Technically, it's fine. However, I think this kind of question will cause students to get frustrated; they'll be penalized for getting the right answer.

At the risk of giving the answers away, I've copied in your cloze question here:

Scout's costume is uncomfortable because:

1) {1:SHORTANSWER:%100%It was hot.#That's right, it was hot!~%100%~%100%it was hot#That's right, it was hot!},

2) {1:SHORTANSWER:%100%It was a close fit.#That's right, it was a close fit!~%100%it was a close fit##That's right, it was a close fit!}, and

3) {1:SHORTANSWER:%100%Once inside she could not get out alone.#That's right, once inside she could not get out alone!~%100%once inside she could not get out alone#That's right, once inside she could not get out alone!}.

The problem with these 'short answewrs' are:
  1. students who write "It was a close fit", for the first blank will be wrong - but it's right isn't it! - well apart from the missing period it's right
  2. Not so serious, but worth knowing is that the cloze questions are not case sensitive, so no need to have two versions of the same sentence.
  3. Also, you've added fullstops in the first correct answer and not in the second for each blank. I realise that you want students to be aware of sentence structure, but also be aware that from the students' point of view they will be penalized for a right answer. If you want to be strict abut full stops and periods, I think it's best to have some kind of reminder at th beginning of quizzes, or even in each question.
  4. As is the case with all short answer questions, the more words required, the more problems students will have, for example, if they accidentally add two spaces between any word, they will be 'wrong'.
So, here's a rewrite of your 3 blanks to solve the above problems:

Scout's costume is uncomfortable because:

1) {1:SHORTANSWER:%100%It*was*hot*#That's right, it was hot!~%100%It*was*a*close*fit*#That's right, it was a close fit!~%100%Once*inside*she*could*not*get*out*alone*#That's right, once inside she could not get out alone!}

2) {1:SHORTANSWER:%100%It*was*hot*#That's right, it was hot!~%100%It*was*a*close*fit*#That's right, it was a close fit!~%100%Once*inside*she*could*not*get*out*alone*#That's right, once inside she could not get out alone!}, and

3) {1:SHORTANSWER:%100%It*was*hot*#That's right, it was hot!~%100%It*was*a*close*fit*#That's right, it was a close fit!~%100%Once*inside*she*could*not*get*out*alone*#That's right, once inside she could not get out alone!}.

I've used wildcards (asterisks) to solve the problem of students accidentally adding spaces. Also, the wildcard at the end means that students will not be penalized for forgetting the period. I've also made it possible for students to write the answers in any order. Of course, this solution has its own problems, for example:
  1. a student who wrote 'It was too hot', for each blank would get full marks
  2. a student that wrote 'It was not too hot' or 'it was gibberish gibberish gibberish hot' would also be marked as correct.
  3. In the same way, the following answer would also be 'correct': 'It was a close fit, but i think that choose your choice of words'.
In other words, the wildcard solves lots of problems, but also allows students to just copy huge swathes of text - as long as the key words were in that text, and in the same order, their copy and past job would be treated as correct. Another solution would be to give credit to students for 'almost correct' answers: e.g.

{1:SHORTANSWER:%100%It*was*hot.#That's right, it was hot!~%70%It*was* hot#Not quite right - you're missing something at the end of the sentence!}

So, you either have to risk students getting frustrated by forcing students to write the 'exact' answers in the 'right' order, or give students the benefit of the doubt with the risk that they'll discover they can abuse the system.

Picture of CA Edington
Re: Quizzes
by CA Edington - Wednesday, 4 April 2007, 10:03 PM
 
Thanks so much for your very thorough explanation, Peter.  I didn't know about wild cards.  It seems that, if used judiciously, they can be a big help in the solving the space/punctuation problem.

As for alternating the choices, I generally do that.  Here's an example of another cloze question I made in which the students could put the answers in any order and still be correct:

Watch the opening credits of the movie. Name some objects in the box.

{1:SHORTANSWER:%100%pocket watch#OK~%100%watch#OK~%100%safety pin#OK~%100%marble#OK~%100%marbles#OK~%100%pennies#OK~%100%coins#OK~%100%coin#OK~%100%mirror#OK~%100%glasses#OK~%100%crayons#OK~%100%crayon#OK~%100%harmonica#OK~%100%whistle#OK~%100%wooden dolls#OK~%100%dolls#OK~%100%doll#OK}

{2:SHORTANSWER:%100%safety pin#OK~%100%marble#OK~%100%marbles#OK~%100%pennies#OK~%100%coins#OK~%100%coin#OK~%100%mirror#OK~%100%glasses#OK~%100%crayons#OK~%100%crayon#OK~%100%harmonica#OK~%100%whistle#OK~%100%wooden dolls#OK~%100%dolls#OK~%100%doll#OK~%100%pocket watch#OK~%100%watch#OK}

{3:SHORTANSWER:%100%marbles#OK~%100%pennies#OK~%100%coins#OK~%100%coin#OK~%100%mirror#OK~%100%glasses#OK~%100%crayons#OK~%100%crayon#OK~%100%harmonica#OK~%100%whistle#OK~%100%wooden dolls#OK~%100%dolls#OK~%100%doll#OK~%100%pocket watch#OK~%100%watch#OK~%100%safety pin#OK~%100%marble#OK}

{4:SHORTANSWER:%100%crayons#OK~%100%crayon#OK~%100%harmonica#OK~%100%whistle#OK~%100%wooden dolls#OK~%100%dolls#OK~%100%doll#OK~%100%pocket watch#OK~%100%watch#OK~%100%safety pin#OK~%100%marble#OK~%100%marbles#OK~%100%pennies#OK~%100%coins#OK~%100%coin#OK~%100%mirror#OK~%100%glasses#OK}

{5:SHORTANSWER:~%100%wooden dolls#OK~%100%dolls#OK~%100%doll#OK~%100%pocket watch#OK~%100%watch#OK~%100%safety pin#OK~%100%marble#OK~%100%marbles#OK~%100%~%100%pennies#OK~%100%coins#OK~%100%coin#OK~%100%mirror#OK~%100%glasses#OK~%100%crayons#OK~%100%crayon#OK~%100%harmonica#OK~%100%whistle#OK}


(There are more choices than spaces because students only have to give 5 answers, even though more are possible.)

I discovered that, by varying the first answers, students can view different possibilities when they want feedback.  It takes more time than just copying the first choice over and over again, but saves time in the end by allowing students to get correct answers for themselves.

Of course, there is the possibility, as you said, that someone might write "doll" and "dolls" and still get credit for it.  However, I trust in students' natural curiosity to find different answers that work.

Anyway, I'll give wild cards a try and let you know what happens.

Gratefully yours,
CA (who will be posting more questions later, you can be sure)



Picture of Peter Ruthven-Stuart
Re: Quizzes
by Peter Ruthven-Stuart - Thursday, 5 April 2007, 10:16 AM
 
CA,

"I discovered that, by varying the first answers, students can view different possibilities when they want feedback.  It takes more time than just copying the first choice over and over again, but saves time in the end by allowing students to get correct answers for themselves."

Yes, good point. But the problem is, I think, with the cloze question type short answer question is that in order to get feedback students have to write something in the blanks that corresponds with something in between the curly brackets { }. So, one solution is to tell students that if they are stuck, they should type a question mark - ? - (or something) and then the teacher has to make a ? (or something) an answer that = 0 points, and have corresponding  feedback that helps students get the answer. See below

{1:SHORTANSWER:%100%It*was*hot*#That's right, it was hot!~%100%It*was*a*close*fit*#That's right, it was a close fit!~%100%Once*inside*she*could*not*get*out*alone*#That's right, once inside she could not get out alone!~%0%?#Have a look at page 34 of To Kill a Mockingbird.}
Picture of CA Edington
Re: Quizzes
by CA Edington - Friday, 6 April 2007, 08:22 PM
 
. . . the problem is, I think, with the cloze question type short answer question is that in order to get feedback students have to write something in the blanks that corresponds with something in between the curly brackets { }. . . .

Peter - When I used the term "feedback," I was being imprecise.  What I meant is when students select "Fill with correct" in order to see the correct answers.  If I don't vary the first choice in each of the 3 answers, students would see "It was hot" as the correct answer 3 times!

You've been really helpful, and I want to express my appreciation again. approve

CA (whose eyes are beginning to take the place of the 2 O's in Moodle!)


Picture of CA Edington
Re: Quizzes
by CA Edington - Monday, 30 April 2007, 10:46 PM
 
After using Moodle with my To Kill a Mockingbird class for 3 weeks now, quite successfully I might add, I have even more questions about the use of Quizzes.  I will list them separately, although in the same forum.

The first concerns the options for the following checkboxes:

Students may review:
Immediately after the attempt:
Later, while the quiz is still open:
After the quiz is closed:
Responses Scores Feedback Answers General feedback Help, Allow review

I'm somewhat at a loss as to which to choose.  Generally, I want students to get immediate Feedback, so I obviously chose Immediately.  I'm wondering, though, whether they can continue to see the Feedback later and when the quiz is closed if I don't check those boxes.

As for Answers, while I don't want students to be able to see them immediately, I want them to have access to them eventually.  However, by choosing "later," just when are they able to view them?

I'd be interested in knowing which boxes any of you check and the reasons.

CA

Picture of Don Hinkelman
Re: Quizzes
by Don Hinkelman - Tuesday, 1 May 2007, 10:24 AM
 
Hi CA,

Feedback:  Yes, I think they can continue to see feedback (especially if you set it so "each attempt builds upon the last").  I haven't confirmed this though.  You can check it by switching to "Student view" and see what happens from their perspective.

Answers:  "Later" means if they submit, leave the quiz and then go back in, they can see the answers as long as the Open dates of the quiz are open.

Cheers, Don
Picture of CA Edington
Re: Quizzes
by CA Edington - Monday, 30 April 2007, 11:04 PM
 
This question regards not being able to add or delete questions because students have already attempted the quiz.

I can understand the reason for that if it involves this year's students.  However, the quizzes at one of the schools still show the attempts by last year's students.

I have deleted the names of the students (class participants).  However, I don't know where to delete the attempts so that I can add/delete questions.

I hope, in particular, to change more of the short answer questions to cloze questions, since it's easier to control the possible choices with the latter.  However, I can't do this with any quizzes that have attempts from previous years.

Your help would be greatly appreciated!

CA
Picture of Don Hinkelman
Re: Quizzes
by Don Hinkelman - Tuesday, 1 May 2007, 10:16 AM
 
There are at least two approaches to change questions once students have attempted a quiz.

Copy the Quiz without user data:  Use the Import tool in your Admin menu.  It removes the user data and restores a fresh quiz to the same course or any course you want.

Delete all Attempts:  In the Quiz results, you may see a link to view all attempts.  Click on that.  Then click all checkboxes of all attempts.  Then go to the bottom and find a dropdown menu that says "delete".  I am telling you from memory, so this is close but may be slightly different when you try it.
Picture of CA Edington
Re: Quizzes - Deleting Previous Attempts
by CA Edington - Tuesday, 1 May 2007, 12:06 PM
 
Don - Thanks so much for your reply.

Since I had to get help importing the quizzes (upgrading from something like version 1.4 to 1.7), I decided to try the second approach.

The steps were:
1) Click on [# students have made # attempts];
2) Change the attempts shown per page to the highest number of attempts;
3) Change the choice in the scroll box to "Show all attempts."
4) Click on GO;
5) Click on Select All (at the bottom left on my screen);
6) In the scroll box that reads "with selected," scroll to "delete;"
7) In the pop-window with the message "Are you sure you want to completely delete these attempts?", click on OK.

It worked!

Only 25 more quizzes to go . . .

Gratefully yours,
CA

P.S.) Finally realized that I should be putting more exact wording in the subject line since I have so many *different* questions about Quizzes.


Picture of CA Edington
Re: Yellow Marks in Editing Quizzes
by CA Edington - Monday, 30 April 2007, 11:47 PM
 
My 3rd question this evening is about grades in some of the questions, such as Cloze or Multiple Choice, where there are a number of correct answers. The box for the grade in the Edit Quiz form sometimes is shaded with yellow.  (I recall seeing this for a couple of the questions as well, and I'll make note of that next time I come across it.)  Does the yellow indicate there's a problem with the question?

If my question is not clear, please let me know.

CA
Picture of Don Hinkelman
Re: Yellow Marks in Editing Quizzes
by Don Hinkelman - Tuesday, 1 May 2007, 10:22 AM
 
I have never seen the yellow shading thing.  Hmmm.  Maybe you are right, there could be a problem with the grade %s adding up.  In a M/C question, if it is a single possible answer, you just have to set the correct answer to 100%.  If it is a multiple-possible answer, you must set both the correct answers to *add up to* 100% and set the incorrect answers to *add up to* -100%. Otherwise students can just click all answers and they will get a perfect score.   Is that clear?   smile
Picture of CA Edington
Re: Yellow Marks in Editing Quizzes
by CA Edington - Tuesday, 1 May 2007, 12:11 PM
 
Hmmmm, not totally clear, Don.  I've never set M/C incorrect answers to *add up to* -100%, but wasn't a problem.  Anyway, I'll play around with it and also see if there are problems with the students' scores.  I'll report back!

Thanks, again,
CA (who hopes her students are working as hard as she is!)

Picture of CA Edington
Re: Quizzes - Where are the answers?
by CA Edington - Wednesday, 9 May 2007, 02:43 PM
 
Hello, again!  (Lots of people out there are apparently subscribed to this forum 'cause people keep telling me they've seen my questions.)

My first question today is a "biggy."  Basically, I want to know why my students can't see the answers, even after they've finished a quiz.

I have checked the box indicating that Students may review ANSWERS
After the quiz is closed.  When students told me they couldn't see the answers, I checked all 3 boxes, including Immediately after the attempt and Later, while the quiz is still open.  (I'm clueless as to what the latter means.  When is "later?"  10 minutes?  1 hour?)  The students still couldn't see the answers.

The previous version of Moodle that I was using (1.4?) was so much simpler.  (sigh)  I will say, however, that I like some of the improvements in the updated version I'm now using (1.7.1?) - particularly being able to sort the questions by date, kind, etc.

Any help with how to display the answers to quizzes would be greatly appreciated by me and the students!

CA
Picture of Eric Hagley
Re: Quizzes - Where are the answers?
by Eric Hagley - Wednesday, 9 May 2007, 05:29 PM
 
CA, just checking, when you set up the quiz there is an option "Open Quiz - Close Quiz". Have you set an "open the quiz" date and time as well as a "close the quiz" date and time? ie You need to check the boxes and set a date and time to open/close the quiz.
By default the open/close setting is set as "always open". If it is always open then the options below it (re showing answers) will be mute. If you set the open and close dates I think you will find that the answers will show as per the settings you choose.

Picture of CA Edington
Re: Quizzes - Where are the answers?
by CA Edington - Wednesday, 9 May 2007, 06:38 PM
 
Thank you for your response, Eric.  I have set open and close dates for all the quizzes.  For example, today's quiz closed at 12:00, 10 minutes before the end of class.  However, the answers weren't displayed after the quiz closed.

CA


Picture of Don Hinkelman
Re: Quizzes - Where are the answers?
by Don Hinkelman - Wednesday, 9 May 2007, 10:21 PM
 
Hi CA,

I have Moodle 1.7.2 and just tried taking a quiz with answers only revealing after the quiz closes.  I closed the quiz, then changed my role to a student.  As a student when I clicked on the quiz, I noticed three things were blue "links" to click on:
  • attempt 1
  • grade out of 6 questions
  • grade out of 100%
Whenever I clicked on any of these, the quiz appeared with all answers revealed.  There was also a button with the word, Continue, but when I clicked that, I just returned to the main course page.  So I would try clicking on any of those links and tell us what you see.

Cheers,  Don
Picture of CA Edington
Re: Quizzes - Where are the answers?
by CA Edington - Wednesday, 9 May 2007, 11:36 PM
 

Thanks for your response, Don.  The following is what I got after attempting the quiz as a student and then submitting it.  There were no blue links.

Review of Attempt 1

Started on:Wednesday, 9 May 2007, 11:09 PM
Completed on:Wednesday, 9 May 2007, 11:15 PM
Time taken:5 mins 46 secs
Raw score:13/23 (57 %)
Grade:13 out of a maximum of 23

Then I went back to the roll as teacher and closed the quiz.  Once more I returned to the student roll and got this:

Attempt CompletedGrade / 23
#1Wednesday, 9 May 2007, 11:15 PM13

I clicked on the blue #1 under Attempt and the blue 13 for the grade.  However, all that showed me was the answers that I had written.  I still couldn't see the correct answers.

The button Continue took me back to the main page, just as it did for you.

This was after checking all the possible boxes for viewing the Answers: after the first attempt, the ambiguous "later," and after the quiz is closed.  I'm baffled.

As I mentioned before, I had no difficult with version 1.4, which I was using last year and which was much less complicated.  Is there some setting I'm missing?  Is there a difference between version 1.7.1 (which I think is the one I'm using, but am not sure how to check) and 1.7.2?

CA (whose classes on Moodle are actually going great!)


Picture of Eric Hagley
Re: Quizzes - Where are the answers?
by Eric Hagley - Thursday, 10 May 2007, 12:20 PM
 
CA, I've had a look at a few of these on my sites and have noticed some funny things.
First thing - if students have set their time zones in their profiles to ones different to the one you have then their "open / close" time will be different to the one you have set for the quiz.
that is, say for example student A has not changed his/her time zone to GMT+9 but left it at GMT. If you have your time zone as GMT+9 and set the close time at 9am, the student who hasn't changed their time zones will see that as closing at 00:00am. Strange!

On all my sites I also cannot see the answers when I set a close time and "show answers". This is something I have never encountered because I never close my quizzes and never select "show answers" - I tell the students to work through the quizzes and if they can't get an answer to message / email me and ask me. I then give them the reasons behind the answer. Still, if I ever should have to use this function, I would want it to work so I am still having a look. Don't know the answer yet, but like you I'll keep looking!
Sorry to be of no help!
Picture of CA Edington
Re: Quizzes - Time Zones [was Where Are the Answers?]
by CA Edington - Thursday, 10 May 2007, 03:09 PM
 
Eric - Whatever you do, don't let my students know about changing the time zone.  They might do it in order to keep the quizzes open longer!  (The "quizzes" are actually questions on each chapter in the novel, To Kill a Mockingbird, that guide them in their reading.)

I put a close time on the quizzes to (1) let students know the deadline and (2) put a little pressure on them to complete them.  Later, I open them up again for those who need extra time.

Actually, when I inputted the usernames & passwords before classes started, the time zone defaulted to GMT + 9, so that problem was taken care of automatically.

Anyway, thanks for your response.  If you discover anything about showing answers, please let me know!

CA


Picture of CA Edington
Re: Quizzes - Where are the answers?
by CA Edington - Sunday, 20 May 2007, 12:09 PM
 
I've found the answers!  But not all of them, and not all the time.

If the quiz is set up so that Students may review: Answers [check box] Immediately after the attempt, they can then see the correct answers for Short Answer questions.

The Multiple Choice and Cloze questions show pink for incorrect answers and green for correct answers.  If I have written in possible incorrect answers with feedback, they can see the feedback as well.

On Cloze questions, they can get feedback by moving the cursor over the answer (if it's an answer they've typed in), but the alignment is a bit off, so it's difficult for them to see which answers are correct.

From what I can tell, it's possible for students to see the answers only if they select the button Submit all and finish at the bottom.  If they selected only Submit page, they can't see the answers, even if the quiz is finished (and is set up for students to review answers once the quiz is finished).  Please let me know if your experience is different from this.

As Don Hinkelman pointed out before, the way for students to see the correct answers is for them to click on the blue number under Attempt or the
blue score under Grade:

Attempt CompletedGrade / 10
#1Sunday, 20 May 2007, 11:07 AM
#2Sunday, 20 May 2007, 11:41 AM2

(Thank you, Don, for "enrolling" in my class of To Kill a Mockingbird to check on that for me.)

I'm still baffled by what Student may review: Answers - Later, while the quiz is still open.  My cats (who act as my students-in-residence) were unable to review the answers when it was set up only for "later."

I also didn't understand why, when students selected
Submit all and finish, they got the following message: "You are about to close this attempt.  Once you close the attempt you will no longer be able to change your answers."  As long as the quiz was still open, they were able to make another attempt and change their answers.  The message is intimidating, to say the least, and it's not correct.

Finally (as though I haven't gone on long enough), I want to thank Eric Hagley for pointing me to the Moodle forum:
http://moodle.org/mod/forum/discuss.php?d=62340   It appears that others have had the same questions as I, and some of the problems are due to the php code with some of the 1.7 versions of moodle that went out.

My questions about using quizzes are still not all answered, but at least my students have more or less successfully completed 9 chapters of the novel so far.  It's really helping to have a way of organizing the class that makes the assignments and deadlines all so clear.

CA (muddling through Moodle)

Picture of CA Edington
Re: Quizzes - The Answers
by CA Edington - Monday, 21 May 2007, 06:11 PM
 
One advantage of the version of Moodle I'm using now (1.7.1?) over the previous one is that, for the Short Questions, it doesn't display all the possible answers that I've written in.  Rather, the current version displays only the first answer I've written as the "correct" answer.

The students got confused when all the answers were displayed.  On the other hand, it showed them the various possibilities.

As I'm sure many of you have experienced, what is most difficult about the Short Questions is that it must match what I've written exactly.  What's challenging is to make students aware that the answer they've written may be fine, even when it's "incorrect" according to the scoring.

Of course, what would be easiest is to make as many Multiple Choice or Matching questions as possible.  However, I want the students to think (egads!), so I'm going to continue with a mixture of questions, including Short Questions.

I'd be interested in hearing about the experiences of others who are using Quizzes.

CA


Picture of Don Hinkelman
Re: Quizzes - The Answers
by Don Hinkelman - Monday, 21 May 2007, 11:11 PM
 
Actually, I never use Short Answer, for the reason you stated--students must type the answer exactly or it is wrong.  Recently, I am using the add-in third-party module called "Feedback".  It has short answer type question.  But it is not a quiz, it is a survey or a brainstorm. So after all the students submit, you can display all answers combined up on a projector.  Fun!

>>I also didn't understand why, when students selected Submit all and finish, they got the following message: "You are about to close this attempt.  Once you close the attempt you will no longer be able to change your answers."  As long as the quiz was still open, they were able to make another attempt and change their answers.  The message is intimidating, to say the least, and it's not correct.

Did you know an admin can change any messages?   Go to the Languages menu and peek around.    You should see "Edit Strings"--which does not mean modify the violins.  In there, you will have to guess the exact php file to edit.  It may take some hit-and-miss poking around.  Then change the wording to something more appropriate.
Picture of CA Edington
Re: Quizzes - The Answers
by CA Edington - Monday, 28 May 2007, 07:51 AM
 
Don, you wrote, "Actually, I never use Short Answer, for the reason you stated--students must type the answer exactly or it is wrong."  For me, it's the reason I like the Short Answer.  cool

On the writing part of the iBT (Internet-based) TOEFL, students must be accurate about punctuation, spacing, and spelling.  For that reason, it's good practice for them.

Also, it's an effective way of teaching those mechanical aspects of writing.  Students pay more attention when it affects their score!

As for those answers that may be worded differently from the possible choices for "correct" ones that I've put in, it's an opportunity for students to learn a bit about paraphrasing.  What's more, they learn that computers are not gods!

Even so, as they're doing the "quizzes" (which I use as guides for focusing on the important points in the novel), I go around trouble-shooting, telling them to check their spelling, etc.

On your suggestion about editing strings, I haven't had a chance to do the "hit-and-miss poking around," yet, but it's good to know that I can alter the wording.

Thanks again for your help.

CA (with more questions to come)


Picture of CA Edington
Re: Quizzes - More on Short Answers
by CA Edington - Thursday, 7 June 2007, 10:03 AM
 
Hello, again!

I'm having more and more success with Short Answer questions.  As I mentioned before, I like them in that it's good practice for students to learn precision (putting a space after a comma and the like).

I'm gradually adding a wild card answer, as time permits.  The instructions on a Moodle site about Short Answers that one of you recommended state, "
As a best practice, add a single wild card * for the last answer, so you can create a feedback response and a score for all other answers students might have."

I've tried this as well as using one word that students are likely to have in their answer surrounded by asterisks (for example, *poor*), and it works!

I browse through the various answers students have given at Item Analysis.  That way I can see the problems with the "incorrect" answers.  If one of the answers is close enough, I'll add it to the correct answers.  I may also add common incorrect answers with feedback.

Example:

Question:  Where does Scout think babies come from?

Actual student answers:

God drops them down the chimney. - Feedback: correct
God drops 'em down the chimney. - Feedback: correct
the chimney - Feedback: How do the babies get down the chimney?
Chimney- Feedback: How do the babies get down the chimney?
God drops babies. - Feedback: Where does God drop the babies?
God drops babies - Feedback: Where does God drop the babies?
God drop\'s em down the chimney. - Feedback: correct
just waitin\' to wake up, he breath life... - [This answer would have no feedback unless there were a wild card with only an asterisk.]
chimmey - [This answer would have no feedback unless there were a wild card with only an asterisk or one with the incorrect spelling and feedback.]
Chimmey - [This answer would have no feedback unless there were a wild card with only an asterisk or one with the incorrect spelling and feedback.]
twilight world - [This answer would have no feedback unless there were a wild card with only an asterisk.]
God drops \'em down the chimney. - Feedback: correct
God drops\'em down the chimney. - [This answer would have feedback if there's a wildcard with *chimney* or *God,* which I haven't made yet.]
chimney - [This answer would have feedback if there's a wildcard with *chimney,* which I haven't made yet.]
God - [This answer would have feedback if there's a wildcard with *God,* which I haven't made yet.]
God drop \'em down the chimney - [This answer would have feedback if there's a wildcard with *chimney* or *God,* which I haven't made yet.]

Don, you mentioned using a 3rd party software to show students all the answers they had written, but I can do that using Item Analysis, plus a bit of copying and pasting.

One more thing I discovered is that I can change the score on students' answers!  I don't have time at the moment to write about how, but the possibility exists if a student's answer is close enough.

CA (who continues to be very enthusiastic about Moodle)