Auto-scoring allows you to automatically score Questionnaires with a click of a button.
You can Auto-Score a Questionnaire based on the way Vendors responded to your questions. To do this you will need to first define what score the vendor should receive based on their responses. We suggest this be done while you are creating the Questionnaire.
This feature must be enabled by Bonfire Support in the backend. Contact us at Support@GoBonfire.com if you wish to enable it.
In this article we will cover the following:
First, let's look at how pre-defining the scoring percentages for a single question. With a Questionnaire in context, the first step will be to create a question by clicking on the Add Question button.
The Add Question box will pop open. As shown below you will see Vendor Response Options and a check box for the Define auto-scoring points allocation.
Define auto-scoring points allocation allows you to optionally assign each Vendor Response Option a percentage of the total points, which will be used to auto-score a question. Vendors will not see these point allocation.
In the below example the Vendor Response Option used is Yes or No.
Under the % of Total Points Allocated, you will fill in what percentage of the points should be allocated based on the vendor's response.
Here, the Vendor will receive a 100% of points if they answer Yes and 0% of the points if they answer No.
While you can set-up the auto-scoring per question, you can also use the Bulk Edit Question button, to define the scoring percentages for many questions at once. The example below will illustrate the steps.
In this Question Set, you can see that there are 7 questions which we wish to bulk edit. Select all questions then click on the Bulk Edit Questions button.
Within the Bulk Edit Questions, you will check off the Change Vendor Response Options and the Define auto-scoring points allocation box.
As per the below example, you can now fill in the Vendor Response Options as well as the % of Total Points Allocated.
3. Setting up Auto-Scoring for Reviewers
As a project owner, you can always give your reviewers the option to Auto-Score under Criteria→Manage . To do this we would suggest the following.
- Go to the Criteria section
- Click on the Manage Button
- Toggle on the Auto-Scoring Feature
*Please note, checking off 'Auto-Scoring' only enables the option for Reviewers to use Auto-Score. This will not apply scores automatically on behalf of the Reviewer.
Next, the reviewer will need to open their scorecard. This is done under the Submissions section as indicated below.
The Scorecard should now appear for the specific vendor being scored. As shown below you will need to click on Score Questions after picking the Question Set to be scored.
From the side-by-side view, you will notice the "Auto-Score" button as well as a "Filter Questions" button as shown below.
The "Filter Questions" button will allow you to filter which question sets are displayed.
The Auto-Score button will allow the user to score all questions that have been filtered. You can quickly check this by looking at the bottom of the screen. In the example above, 68 questions are about to be auto-scored.
In our example, the questions to be auto-scored contain a mix of 3 distinct selections of auto-scoreable questions:
- Fully Compliant/Partially Compliant/Non-Compliant
- Available/Requires Work/Not Available
There is also a Comment box for reviewers enabling them to assign scoring comments in bulk for each set of questions being auto-scored.
Bonfire automatically inserts a generic scoring comment outlining the auto-scoring methodology that was applied. Once the auto-score has been completed, the comment will be attached to all questions that were auto-scored. You will be able to edit these comments if required.
The reviewer inputs the percentage of the point value that is to be assigned to each question. For instance, if the questions were out of 4 points each, then a question that was answered as "Fully Compliant" will receive 4 points, "Partially Compliant" will receive 2 points, and so forth. Once you have entered in your desired percentages on each response type, you will click on Auto-Score button as shown above.
After completing an Auto-Score, your scoring progress will be updated immediately. If you click on any of the scored questions within the scorecard, you will see the comments section has been updated with the comments generated from the Auto-Score. This comment section can also be edited as shown below.
If you have any questions or suggestions please reach out to us at Support@GoBonfire.com