AI suggestions and visit recording

Steve can suggest answers to factual questions, such as "Was the receipt total above 100 PLN?" or "Did the advisor offer a loyalty card?", from what the shopper captured during the visit:

• the data Steve read from a receipt or photo,
• what was said in the visit recording, when the survey records visits.

Every suggestion comes with where Steve found it: the receipt field it read, or the words from the recording and the moment they were said. Steve drops a suggestion it can't point to. The shopper still decides every answer: they confirm or change each suggestion, one question at a time.

Set it up in the builder

AI can suggest

Each shopper question has an AI can suggest switch in its settings. It starts from the question type:

Turn it off for questions about the shopper's impression, such as "Was the advisor friendly?". The type alone can't tell an opinion from a fact. Turn it on for a text question when the answer is a fact, such as the advisor's name on a badge.

The verifier questionnaire has no switch: Steve suggests answers to the shopper only.

Visit recording

The Settings tab sets Visit recording for the shopper questionnaire:

Why it is required is shown to the shopper before the visit, up to 140 characters. It is needed for Required.

Transcribe it with picks the audio workflow that transcribes recordings. It must be:

• switched on,
• an audio workflow,
• granted to at least one company,
• set to accept up to 60 files and need only 1. A recording arrives in parts of about a minute, so 60 files cover the longest visit, 60 minutes.

Workflows that don't qualify are listed with the reason and can't be picked. When you assign a visit, Steve checks that the field user's company has access to this workflow and refuses the assignment if it doesn't, so grant it to every company that does visits.

When recording is Off and some questions have AI can suggest on, the publish checklist says "Recording is off, so AI suggestions use receipts and photos only." under Worth a look. It doesn't block publishing.

Recording settings are part of the published version, like the questions. Changing them creates a new version when you publish, and Versions lists the change under Visit recording.

In the field app

Recording the visit

With recording on, Start visit starts the recording, with a short vibration. If the shopper didn't tick Record this visit on an optional survey, the visit screen offers Start recording.

While recording, the visit screen shows Recording with the time recorded and End visit. The shopper can lock the phone and put it away: the recording continues.

• iPhone: the microphone indicator shows in the status bar while the app records.
• Android: a notification shows while the app records. Its Stop button stops the recording, not the visit. The app then shows Recording stopped with Resume.

A call or another app taking the microphone stops the recording the same way. The shopper taps Resume to continue; Steve keeps both parts as one recording.

To finish, the shopper taps End visit in the app. The lock screen has no End visit button yet.

The app uploads the recording in parts of about a minute while the visit goes on, also without a connection: parts wait on the phone and upload when the connection is back. At 60 minutes the recording ends on its own and the app shows Recording ended at 60 minutes.

If the app is closed or the phone runs out of battery, the shopper loses at most the last minute. When they open the visit again, it says Recording stopped when the app closed with Resume.

If a part can't be uploaded because its file is gone from the phone, the app says which one and offers Finish without part 3 (or whichever part). The recording is then marked incomplete for the verifier. Steve never drops a part without saying so.

Signing out of the app, or another account signing in on the phone, stops a running recording. What was recorded stays on the phone and uploads the next time that shopper signs in; their visit then shows Recording stopped with Resume.

If a part of a received recording has no transcript (transcription failed or found no words), the app says so under Recording received by Steve, for example "Part 2 has no transcript, so AI can't suggest answers from it."

Playing a clip or a recording elsewhere in the app doesn't stop a visit recording.

Permissions

The first recording asks for the microphone. The app doesn't ask to show notifications: on Android 13 and later, the recording notification with its Stop button shows only if notifications are allowed for Steve in the phone's settings. The recording works either way. If the shopper refuses the microphone, the app can't record; on a survey with Required recording, a coordinator can import a recording instead.

Confirm or change a suggestion

When Steve has a suggestion for a question the shopper hasn't answered yet, the question shows it with its source, for example:

• "From your recording at 4:32" with the words quoted and a button to play that moment,
• "Read from your receipt: Total 129,99 zł" with the receipt photo one tap away.

The shopper taps Confirm to take the suggestion, or Change to answer it themselves. Change leaves the answer empty instead of keeping the suggested value, and "AI suggested: Yes" stays under the question. There is no button that accepts all suggestions at once.

While Steve is still working, a question can show "Checking your recording…" or "Checking your receipt…". If the check fails, it says "Couldn't check the evidence" and the shopper answers as usual. An open visit asks Steve to check again after a minute and, if that fails too, after another five minutes; then it stops trying.

Suggestions never overwrite an answer

A suggestion can arrive after the shopper already answered, for example when the recording is transcribed late. Steve never changes that answer. If the suggestion differs, a quiet note appears under the question, such as "Your recording suggests: No", with the clip. The shopper can tap Use suggestion or leave their answer. Either way the verifier sees the difference.

Confirming and changing work offline like any answer and upload when the connection is back.

On the response page

Where each answer came from

Once Steve has suggested anything for a visit, every shopper answer shows where it came from, in small text under the answer:

• Manual: the shopper answered without a suggestion.
• AI confirmed: the shopper confirmed Steve's suggestion. The source is shown.
• AI changed: the shopper replaced Steve's suggestion. "AI suggested: 129.99 PLN" shows what Steve had suggested, with its source.

A recording source shows the quoted words, when they were said, and Play clip, which plays only that moment. A receipt or photo source shows the field Steve read, its value and the page, with Show receipt to scroll to the photo.

Disagreements

When a suggestion differs from the shopper's answer, the answer shows a note such as "The recording suggests: No" with its source. Above the answers, a line counts them: "1 answer differs from what the evidence suggests". A difference doesn't block accepting. It is there for you to check.

Shopper's confirmations

Under Shopper's answers, a line summarizes how this shopper decided on suggestions in this company over the last 90 days, for example: "Ola Nowak confirmed 41 of 50 suggestions (82%), median 3.1 s to confirm, 6 without timing, last 90 days". The time to confirm is measured on the phone from when the suggestion appeared to the tap. "Without timing" counts confirmations whose time is unknown, for example from an older app. The line doesn't show for a shopper who has never decided on a suggestion.

The recording

A survey with recording on shows a Visit recording card above the answers, one entry per recording:

Each entry shows how many parts arrived and the length. Listen to 5 parts opens the parts, each with its own Play.

Import a recording

If the shopper recorded the visit with another app, a coordinator with review access can add the file on the response page: click Import recording and pick an MP3, M4A or WAV file. The card shows "Uploading" and then "Steve is checking" until the recording shows as received.

• WhatsApp voice notes (Opus) can't be imported yet. Convert them to MP3 first.
• Importing works while the visit is in progress or sent, not after it is accepted or cancelled.
• An imported file counts as the recording for Required.
• Times in an imported file count from the start of the file, not the start of the visit.

Accepting waits for recordings and suggestions

Before accepting: also lists "A recording is still arriving" and "AI is still checking the evidence". Accept once they are done. Accepting freezes which recordings and suggestions the visit had, together with the answers and the score.

Citation times: exact or approximate

When the transcription service gives timings, a citation shows the exact moment: "at 4:32", counted from the start of the visit. When it gives none, Steve only knows which minute-long part the words are in and says "around 4:00". Play clip then plays the whole part.

In the demo app

The demo app shows suggestions with Confirm, Change and Use suggestion like the phone app. Recording works differently in a browser:

• Start visit opens the microphone and starts the recording; the browser asks for the microphone the first time. The recording runs while the demo tab stays open. There is no recording with a phone's screen locked and no vibration.
• A tab records one visit at a time, so use one tab per field user. The time shown is the audio recorded so far.
• Reloading or closing the tab loses the audio not yet cut into a part (at most the last minute) and any part not yet sent. The visit then shows Recording stopped with Resume recording and End visit.
• After End visit, a part whose upload failed shows Send part 3 again (or whichever part), and a part lost with the page shows Finish without part 3. The recording is then marked incomplete for the verifier.
• Send visit to Steve waits until the parts still uploading in the tab have reached Steve, also on a survey where recording is optional.
• A recording ends at 60 minutes.
• Instead of recording, the operator can click Add a recording file instead and pick an MP3, M4A or WAV file of up to 60 minutes. The browser converts it and sends it as the visit's recording, in parts of a minute, like a recording made in the tab. Times then count from the start of the file.

Recordings, consent and retention

Whether shoppers may record visits, what they tell the people they speak to, and how long recordings are kept are your organization's decisions. Steve doesn't make that call for you. Recording is off unless you turn it on for a survey.

A recording is kept as an audio submission of the workflow you picked, with the same retention as your other audio submissions. Transcribed words quoted in a suggestion disappear from the response page when the transcript expires.