How We Evaluate AI Assistants
We don't rank products by who pays us the most. Here's exactly what we look at — and what gets a vendor removed.
What we test
- Response accuracy and hallucination rate
- Natural language comprehension
- Integration capabilities
- Handoff to human agents
- Compliance and data handling
- Pricing transparency
- Customer support responsiveness
- Real-world performance (not just demos)
What disqualifies a vendor
- Hallucination rate above threshold with no mitigation
- No human handoff option
- Fake or misleading compliance claims
- Bait-and-switch pricing
- Refusal to provide test access
- Poor customer support with no improvement plan
Transparency
We earn referral fees from some of the vendors we recommend. This is always disclosed to buyers. Referral relationships never influence our evaluations, rankings, or matching decisions. Vendors cannot pay for higher rankings or guaranteed introductions. If we wouldn't recommend a vendor to a friend's business, we don't recommend them to yours.
Our review process
- Application and initial screening
- Product and documentation review
- Testing (accuracy, handoff, integrations)
- Compliance and pricing verification
- Decision: list, decline, or request improvements