Mike is an experienced Product Manager who focuses on all the “non-development” areas of My AskAI, from finance and customer success to product design, copywriting, testing and more.
If you are currently testing out AI support solutions and have no idea how to compare their answer quality, here are a few pointers:
- Answer accuracy: Did it answer the question correctly?
- Incorrect answers: Did it answer any questions incorrectly (a big red flag)?
- Conciseness: AI tends to ramble, but customers don’t tend to like reading long responses, so make sure the ones you get are of an appropriate length.
- Source accuracy: Did it provide what you would deem to be the most relevant sources (links or documents) back in the answer for further reading?
- Answer tone: Does it fit with your company and brand?
- Clarifications: Did it ask follow-up questions if the question was vague?
- Focus: Did it answer anything it shouldn’t, did it go off-topic or talk about competitors?
- Conversation: How did it handle small talk or informal conversation?