Manual Evaluation of AI Conversations in Zendesk QA
How do I manually evaluate AI agent conversations in Zendesk QA?
To manually evaluate AI agent conversations in Zendesk QA, you need to set up a scorecard for the categories you want to assess.
Start by clicking the Conversations icon, then select or create a filter to identify the bot conversations you wish to review. Choose the conversation, select the bot in the Reviewee field, and pick a scorecard. Rate the bot's performance for each category and optionally add comments. Finally, click Submit to complete the evaluation.
More related questions
How can I evaluate the performance of AI agents using Zendesk QA?
You can evaluate the performance of AI agents using Zendesk QA by analyzing their interactions with customers. This involves both manual and automatic evaluation methods. For manual evaluation, you set up a scorecard to assess various performance…
Which AI agents can be evaluated using Zendesk QA?
Zendesk QA can evaluate various types of AI agents, including conversation bots, Ultimate messaging bots, and bots created with Sunshine Conversations. To see which bots have been detected, navigate to Zendesk QA, click your profile icon, select…
What is AutoScoring in Zendesk QA and how does it work?
AutoScoring in Zendesk QA is a feature that automatically evaluates bot conversations based on predefined categories. Once AutoScoring is set up, it assesses bots on categories like Greeting, Empathy, and Tone. The results are visible in the Review…
Can Zendesk QA evaluate AI agents from platforms like Intercom?
Zendesk QA is primarily designed for evaluating AI agents within the Zendesk ecosystem, such as conversation bots and Sunshine Conversations bots. While you can connect Intercom to Zendesk QA, the AI agent monitoring feature is specifically built…
Interested indeflectingover 70% of your Zendesk support tickets?
Zendesk Support Tickets
Zendesk Messaging (live chat)
Join1,000+ companies reducing their support costs and freeing up support agents for more important work
“We needed an AI agent integrated within our current tools. My AskAI was the only solution that wasn't going to disrupt our operations.”
Zeffy
“At the end of last year I was given the challenge - how can we provide the same or better service, without hiring anyone?”
Zinc
“My AskAI blew everybody else out of the water. It made the selection process very easy for us.”
Customer.io($50M+ ARR)
“It now resolves 71% of queries (over 35,000 every month), meaning more time solving complex issues and improving UX.”
Freecash
“We needed an AI agent integrated within our current tools. My AskAI was the only solution that wasn't going to disrupt our operations.”
Zeffy
“At the end of last year I was given the challenge - how can we provide the same or better service, without hiring anyone?”
Zinc
“My AskAI blew everybody else out of the water. It made the selection process very easy for us.”
Customer.io($50M+ ARR)
“It now resolves 71% of queries (over 35,000 every month), meaning more time solving complex issues and improving UX.”
Freecash
Reduce support costs.Spend more time on customer success.
