| 1 |
efrain |
1 |
@mod @mod_quiz
|
|
|
2 |
Feature: Set a quiz with certainty-based marking
|
|
|
3 |
As a teacher
|
|
|
4 |
In order to set a a quiz with certainty-based marking
|
|
|
5 |
I should set question behaviour to "Immediate feedback with CBM"
|
|
|
6 |
|
|
|
7 |
Background:
|
|
|
8 |
Given the following "users" exist:
|
|
|
9 |
| username | firstname | lastname | email |
|
|
|
10 |
| student1 | Student | One | student1@example.com |
|
|
|
11 |
| teacher1 | Teacher | One | teacher1@example.com |
|
|
|
12 |
And the following "courses" exist:
|
|
|
13 |
| fullname | shortname | category |
|
|
|
14 |
| Course 1 | C1 | 0 |
|
|
|
15 |
And the following "course enrolments" exist:
|
|
|
16 |
| user | course | role |
|
|
|
17 |
| student1 | C1 | student |
|
|
|
18 |
| teacher1 | C1 | editingteacher |
|
|
|
19 |
And the following "question categories" exist:
|
|
|
20 |
| contextlevel | reference | name |
|
|
|
21 |
| Course | C1 | Test questions |
|
|
|
22 |
And the following "questions" exist:
|
|
|
23 |
| questioncategory | qtype | name | questiontext |
|
|
|
24 |
| Test questions | truefalse | TF1 | First question |
|
|
|
25 |
| Test questions | truefalse | TF2 | Second question |
|
|
|
26 |
| Test questions | truefalse | TF3 | Third question |
|
|
|
27 |
And the following "activities" exist:
|
|
|
28 |
| activity | name | course |
|
|
|
29 |
| quiz | Quiz 1 | C1 |
|
|
|
30 |
And quiz "Quiz 1" contains the following questions:
|
|
|
31 |
| question | page |
|
|
|
32 |
| TF1 | 1 |
|
|
|
33 |
| TF2 | 2 |
|
|
|
34 |
| TF3 | 3 |
|
|
|
35 |
|
|
|
36 |
@javascript
|
|
|
37 |
Scenario: Teacher can set a quiz with certainty-based marking
|
|
|
38 |
Given I am on the "Quiz 1" "quiz activity editing" page logged in as teacher1
|
|
|
39 |
And I set the following fields to these values:
|
|
|
40 |
| preferredbehaviour | immediatecbm |
|
|
|
41 |
And I press "Save and return to course"
|
|
|
42 |
And I am on the "Quiz 1" "quiz activity" page logged in as student1
|
|
|
43 |
When I press "Attempt quiz"
|
|
|
44 |
# Press "Check" without selecting a certainty
|
|
|
45 |
And I press "Check"
|
|
|
46 |
# Confirm that "Please select a certainty." is displayed when "Check" is pressed
|
|
|
47 |
Then I should see "Please select a certainty."
|
|
|
48 |
And I click on "True" "radio" in the "First question" "question"
|
|
|
49 |
And I click on "C=1 (Unsure: <67%)" "radio" in the "First question" "question"
|
|
|
50 |
And I press "Next page"
|
|
|
51 |
And I click on "False" "radio" in the "Second question" "question"
|
|
|
52 |
And I click on "C=2 (Mid: >67%)" "radio" in the "Second question" "question"
|
|
|
53 |
And I press "Next page"
|
|
|
54 |
And I click on "True" "radio" in the "Third question" "question"
|
|
|
55 |
And I click on "C=3 (Quite sure: >80%)" "radio" in the "Third question" "question"
|
|
|
56 |
And I press "Finish attempt ..."
|
|
|
57 |
And I press "Submit all and finish"
|
|
|
58 |
And I click on "Submit all and finish" "button" in the "Submit all your answers and finish?" "dialogue"
|
|
|
59 |
# As student1, confirm the results of own attempt
|
|
|
60 |
And the following should exist in the "quizreviewsummary" table:
|
|
|
61 |
| -1- | -2- |
|
|
|
62 |
| Marks | 2.00/3.00 |
|
|
|
63 |
| Grade | 66.67 out of 100.00 |
|
|
|
64 |
| Average CBM mark | 0.67 |
|
|
|
65 |
| Accuracy | 66.7% |
|
|
|
66 |
| CBM bonus | 0.0% |
|
|
|
67 |
| Accuracy + Bonus | 66.7% |
|
|
|
68 |
| C=3 | Responses: 1. Accuracy: 100%. (Optimal range 80% to 100%). You were OK using this certainty level. |
|
|
|
69 |
| C=2 | Responses: 1. Accuracy: 0%. (Optimal range 67% to 80%). You were a bit over-confident using this certainty level. |
|
|
|
70 |
| C=1 | Responses: 1. Accuracy: 100%. (Optimal range 0% to 67%). You were a bit under-confident using this certainty level. |
|
|
|
71 |
And I should see "CBM mark 1.00" in the "First question" "question"
|
|
|
72 |
And I should see "CBM mark -2.00" in the "Second question" "question"
|
|
|
73 |
And I should see "CBM mark 3.00" in the "Third question" "question"
|
|
|
74 |
# As teacher, confirm same quiz contents
|
|
|
75 |
And I am on the "Quiz 1" "quiz activity" page logged in as teacher1
|
|
|
76 |
And I press "Preview quiz"
|
|
|
77 |
And I should see "C=1 (Unsure: <67%)"
|
|
|
78 |
And I should see "C=2 (Mid: >67%)"
|
|
|
79 |
And I should see "C=3 (Quite sure: >80%)"
|
|
|
80 |
And I am on the "Quiz 1" "mod_quiz > Grades report" page
|
|
|
81 |
And I click on "Review attempt" "link" in the "Student One" "table_row"
|
|
|
82 |
# As teacher, confirm that the attempt result is same with student1 view
|
|
|
83 |
And the following should exist in the "quizreviewsummary" table:
|
|
|
84 |
| -1- | -2- |
|
|
|
85 |
| Marks | 2.00/3.00 |
|
|
|
86 |
| Grade | 66.67 out of 100.00 |
|
|
|
87 |
| Average CBM mark | 0.67 |
|
|
|
88 |
| Accuracy | 66.7% |
|
|
|
89 |
| CBM bonus | 0.0% |
|
|
|
90 |
| Accuracy + Bonus | 66.7% |
|
|
|
91 |
| C=3 | Responses: 1. Accuracy: 100%. (Optimal range 80% to 100%). You were OK using this certainty level. |
|
|
|
92 |
| C=2 | Responses: 1. Accuracy: 0%. (Optimal range 67% to 80%). You were a bit over-confident using this certainty level. |
|
|
|
93 |
| C=1 | Responses: 1. Accuracy: 100%. (Optimal range 0% to 67%). You were a bit under-confident using this certainty level. |
|
|
|
94 |
And I should see "CBM mark 1.00" in the "First question" "question"
|
|
|
95 |
And I should see "CBM mark -2.00" in the "Second question" "question"
|
|
|
96 |
And I should see "CBM mark 3.00" in the "Third question" "question"
|