How are Open Response Scores Evaluated?
What is the Open Response Score?
The Open Response Score is a measure of answer relevance and Learner effort in Essay and Short Answer questions. Answers for each required question are evaluated to produce a score for that question. Individual question scores are averaged to produce a lesson-level Open Response Score. Lesson scores are averaged to produce the overall course Open Response Score.
Open Response Scores allow Learners to prove they're meaningfully engaged in content, particularly with respect to self-reflection and the application of critical thinking skills to course topics.
How are Open Response questions evaluated?
Essay and Short Answer questions are evaluated algorithmically and in real time. Learners see immediate feedback upon submitting a response. This feedback and the answer score is generated through a series of automated validations checking for answer length, the presence of real words (as opposed to gibberish responses), answer uniqueness, and can optionally include an enhanced relevance check powered by machine learning. An answer will receive full credit (100), partial credit (25-75), or no credit (0) depending on validation results.
Note: Enhanced machine-learning Open Response Scoring is a premium feature optionally available to agencies. If you would like to enable this feature at your agency, please contact your tablet provider to inquire about premium options.
Learners are encouraged to improve any answers that don't receive full credit and have a total of 3 attempts to submit a response for each open response question per lesson take. Skipping a required question results in an automatic no credit (0) score for that question and an answer cannot be submitted once a question is skipped in a given take.
If a Learner submits a low effort response, they will see feedback recommending they improve their answer and have the opportunity to edit it.
What can a Learner do if they notice a problem with their answer evaluation?
In the event that a Learner believes there's an issue with their answer score, they can click the flag icon that appears alongside their answer feedback to report an error. Answer error reports are used by the Edovo team to improve the answer evaluation algorithm.
Related Articles
How to View and Update a Learner's Open Response Score
The Open Response Score is a measure of Learner effort and answer relevance for Essay and Short Answer questions in courses. In Insight, you can now view a Learner's Open Response Score on the Course Engagement and Course Enrollments screens. To ...Adding Quiz and Survey Questions to Content
Multiple Choice To add a graded multiple choice question: On the desired content page, click the “Multiple Choice” option from the Quiz Items menu on the bottom left of your screen. You will see the multiple choice input field added to the bottom of ...Creating a Course using Edovo Editor
Edovo provides a tool to create your own coursework. This tool can be used by Facility staff members, local community partners looking to create and share their content or relevant resources, or anyone else the facility deems necessary. Staff Members ...Understanding Course Scores: Passed vs Needs Improvement
When a learner completes a course, they receive one of two potential final scores: Passed, meaning the learner met all requirements for completing the course with evidence of effort, meaningful engagement, and a sufficient grasp of the material. ...How to Upload a Learning Resource to Edovo?
What is a learning resource? For content partners or facilities that have materials they wish to upload that are Learning Resources, such as books, podcasts, inspirational videos, flyers, or other materials of the like, these Learning Resources can ...