Custom GPT bots
Is your Custom GPT bots bot telling customers what your website says?
Custom bots on OpenAI or Anthropic models answer from whatever they were given. We test what they tell customers against your own pages.
How Built in-house or by an agency charges
Usually a model provider bills per token, and a builder like Botpress bills per conversation with AI usage on top, plus whatever the agency charges. Cost follows usage; nothing in the bill tells you if answers are right.
What Built in-house or by an agency gives you to test
Testing is whatever the builder set up. That might be a few manual chats before launch, an evaluation script, or a test tool inside the chosen framework. There is rarely anything that compares answers with the live website after launch.
What an outside check adds
Your platform tests the bot against its sources. We test it against your website.
- 01
We are independent of whoever built the bot, so the result isn’t the builder marking their own work.
- 02
Custom prompts and retrieval differ from bot to bot. We don’t need access: we test the bot the way customers reach it.
- 03
Assistant Care re-runs the questions every week and fixes what moved, so a site change, model update or prompt edit doesn’t quietly break answers.
Typical failure patterns on Custom GPT bots
The neighbouring row
Retrieval brings back the right table, and the model reads the wrong line: the pricier room, the member price instead of the regular one.
Model or provider outage
The provider API key expires, a quota runs out or a model is retired. The widget stays on the page and returns an error or nothing at all.
Prompt says one thing, site says another
The system prompt was written at launch with prices or hours pasted in. The website changed; the prompt didn’t.
Sources
Checked October 2026; vendors change plans often. Supa Brain is independent and not a partner of Built in-house or by an agency. Product names belong to their owners.
Other platforms
See your assistant answer your customers first
Email us your store’s address. Within a working day you get five questions your customers ask and the answers your assistant would give, each with the page it comes from. Free, no call needed.