SteveScoring
Give points to questions, weigh sections and see how Steve calculates a visit's score.
A visit's score comes from the shopper questionnaire only. The verifier questionnaire is never scored: the verifier judges the visit, the field user's answers make the score.
New questions start unscored. Giving points is a deliberate step on the Scoring tab.
Points and weights
Three question types can carry points:
| Type | How points work |
|---|---|
| Yes or no | Points for Yes. Yes earns the points, No earns none. |
| One choice | Each answer earns its own points. Tick Leave out of the score on an answer that should count like Not applicable. |
| Rating | Points at the top of the scale, scored on a straight line from the bottom of the scale to the top. |
Points are whole numbers from 0 to 100. A scored question must be required, or a skipped answer would quietly change the score. If it isn't, the Scoring tab offers Make required.
Each section has a Weight, a whole number from 1 to 100. Next to it the tab shows that section's share of the total, for example "40% of the total score". A section without points doesn't count.
How the score is calculated
- For each section, Steve adds up the points earned and the points that applied. The section's percentage is earned ÷ applied.
- The total is the average of the section percentages, weighted by section weight. Only sections where something applied take part.
- The result is rounded to one decimal place.
A rating answer earns points × (answer − lowest) ÷ (highest − lowest). On a 1 to 5 scale worth 3 points, a 4 earns 3 × 3 ÷ 4 = 2.25 points.
Some answers are left out of the points that applied:
- Not applicable, and a one-choice answer marked Leave out of the score.
- Hidden questions and sections, even if they were answered before their rule hid them.
- Could not verify. It is never treated as No. Steve counts it next to the score, so one Yes and nine Could not verify never look like ten verified answers.
If nothing applied at all, for example every scored answer was Not applicable, the visit reads Not scored instead of 0%.
Next to every score, Steve shows how many answers were scored, how many could not be verified and how many were not applicable.
A worked example
This is the visit in the Reviewing visits screenshots. Arrival has weight 2 and Conversation weight 3. The other sections carry no points.
| Section | Question | Answer | Earned | Applied |
|---|---|---|---|---|
| Arrival | Did someone greet you within two minutes? (2 points for Yes) | No | 0 | 2 |
| Arrival | How tidy was the store? (1 to 5, 3 points at 5) | 4 | 2.25 | 3 |
| Conversation | Did the consultant ask what you were looking for? (3 points for Yes) | Yes | 3 | 3 |
| Conversation | What did the consultant recommend? (up to 3 points) | An answer worth 3 points | 3 | 3 |
| Conversation | Were you offered the CHIC loyalty card? | Could not verify | – | – |
- Arrival: 2.25 ÷ 5 = 45%.
- Conversation: 6 ÷ 6 = 100%. The loyalty card question is left out and counted as one unverified answer.
- Total: (2 × 45% + 3 × 100%) ÷ (2 + 3) = 78%, with 4 answers scored, 1 could not verify and 0 not applicable.
Adding up all points instead would give 8.25 ÷ 11 = 75%. The weights are why the total is 78%.
When the score is final
Until a verifier accepts the visit, the admin shows the Score so far, calculated from the shopper's current answers. Accepting the visit freezes the score with the answers it was calculated from. Later edits to the survey don't change it. See Reviewing visits.