Zendesk AI agents
Is your Zendesk AI agents bot telling customers what your website says?
Zendesk AI agents answer from your help centre and are billed per automated resolution. We test them against your live site as a customer.
How Zendesk charges
Zendesk bills AI agent usage in automated resolutions. Under resolution tiers, a Verified resolution, confirmed by an LLM reading the conversation, draws from your allowance; Contained resolutions and assisted escalations do not.
What Zendesk gives you to test
Zendesk provides a test widget that simulates the current customer experience, including instructions, persona and escalation messages, and a conversation simulator that generates realistic conversations from scenarios you write. Test conversations don’t consume automated resolutions. Zendesk itself advises using testers who didn’t build the flows.
What an outside check adds
Your platform tests the bot against its sources. We test it against your website.
- 01
The verification model reads the conversation, not your website. If the bot states the wrong fee and the customer says thanks, the conversation can look resolved.
- 02
We are the outside tester Zendesk recommends: we didn’t build your flows and we don’t know which questions they were written for.
- 03
We compare answers with your live pages, not with the help centre, so we catch articles that have fallen behind the site.
Typical failure patterns on Zendesk AI agents
Answering from the wrong article
Two articles cover similar ground, for example UK and international delivery. The bot picks the wrong one and gives the other region’s times or costs.
Old articles, new policy
The website was updated, the help centre article wasn’t. The bot repeats the old returns window or the old opening hours word for word.
Generic fallback on a published fact
Asked something your site answers plainly, the bot replies with a list of links or a generic “I can’t help with that”, then offers to create a ticket.
Sources
- Zendesk: About automated resolution tiers
- Zendesk: About automated resolutions for AI agents
- Zendesk: Best practices for testing AI agents
Checked October 2026; vendors change plans often. Supa Brain is independent and not a partner of Zendesk. Product names belong to their owners.
Other platforms
See your assistant answer your customers first
Email us your store’s address. Within a working day you get five questions your customers ask and the answers your assistant would give, each with the page it comes from. Free, no call needed.