Skip to content
Supa Brain

Sample check

What a check of answers looks like

The starting check for a chatbot you already have, and the same method as the 100-question test before an assistant goes live and the weekly Care check. A full sample for a made-up business, Harbour View Hotel: the mistakes follow the patterns we find in real tests; the business, the pages and the figures are invented.

Starting check · harbourviewhotel.example · sample

Harbour View Hotel, website assistant

Tested
Tue–Wed, business hours
Questions
104, incl. 26 follow-ups
Pages compared
23

Step 1 · the score

Scorecard · sample

Starting check

Sample
Asked
104
Right
87
Wrong
17
Critical
5
By topic
TopicAskedWrong
Prices and plans247
Delivery and returns184
Hours and locations142
Booking and cancellation223
Follow-up questions261

Step 2 · the report

Every wrong answer, worst first. 4 of 17 shown.

P-03CriticalWrong price

How much is a triple room with breakfast?

A triple room is €175 per night, breakfast included.

Your page

Triple Room · €145 per night, breakfast included

harbourviewhotel.example/rates

Why it matters

The bot read the Family Suite row below. Every group of three who asks gets a price €30 a night too high, and some book elsewhere.

Fix

In the knowledge base, replace the rates table with one line per room: “Triple Room: €145 per night, breakfast included, up to 3 adults.”

P-07CriticalInvented policy

If I cancel the day before, do I get my deposit back?

Yes, deposits are fully refundable up to 24 hours before check-in.

Your page

Deposits are non-refundable within 7 days of arrival. They can be moved to another date once.

harbourviewhotel.example/booking-terms

Why it matters

A refund promise in writing on your site. A guest who cancels the day before will quote it back to you.

Fix

Add the booking terms page to the bot’s sources. Instruction: “For cancellations and refunds, quote the booking terms and link them. Never promise a refund.”

H-02HighDoesn’t know

Do you have parking?

I don’t have information about parking.

Your page

On-site parking €15 per night. Book it with your room or at check-in.

harbourviewhotel.example/getting-here

Why it matters

Guests arriving by car decide on parking before they book. The one who can’t get an answer books a hotel that gives one.

Fix

Add the “Getting here” page to the sources; it holds parking and isn’t in the FAQ.

F-01MediumDifferent question

Can I use the spa if I’m not staying at the hotel?

All our rooms include free access to the spa.

Your page

Spa day passes for non-guests: €35, weekdays 10:00–18:00.

harbourviewhotel.example/spa

Why it matters

The visitor asked about a day pass and got an answer for guests. They rarely ask twice.

Fix

Split the spa article into “Spa for hotel guests” and “Spa day passes” with the audience in every heading.

Step 3 · re-test

17

wrong before

2

wrong after

Sample figures. The two left are follow-ups the bot still gets wrong; with Care, they are fixed in the next weekly round.

Ask about your bot

See your assistant answer your customers first

Email us your store’s address. Within a working day you get five questions your customers ask and the answers your assistant would give, each with the page it comes from. Free, no call needed.