1
Define the queue
Choose the recurring questions and channels the agent is allowed to handle.
Support-agent guide
For most small businesses, the best AI support agent is not the one that promises the most automation. It is the one that answers from approved knowledge, verifies customer context, stops safely when it is uncertain, and gives a human the full conversation when the case needs judgment. Zeiko Support is built around that operating loop.
By the Zeiko team · Updated 2026-08-04
Use the same questions for every vendor. This keeps a polished demo from hiding the operational details that determine whether a small team can trust the agent in live conversations.
| Criterion | Buyer question | Zeiko approach | Evidence to check |
|---|---|---|---|
| Answer quality | Can the agent answer routine questions from approved sources? | Ground replies in approved knowledge, tickets, procedures, and verified Shopify context. | Review sampled conversations and unresolved cases. |
| Action safety | Can it act without creating silent operational risk? | Use tool traces, approval gates, scoped procedures, and human review for consequential actions. | Inspect approvals, receipts, and failed-action handling. |
| Human handoff | Does a person receive the full context when automation stops? | Create durable ticket-backed handoffs with assignment state, transcript context, and customer-visible follow-up. | Test an unresolved request end to end. |
| Improvement loop | Can the team turn missed cases into safe improvements? | Use Support QA, simulations, replays, and proof review before changing public behavior. | Compare a baseline run with an approved change. |
Vendor evaluation scorecard
Give each criterion zero, one, or two points. A perfect score is 20, but any zero in grounding, handoff, approvals, or data controls should stop a live rollout until the vendor proves the missing safeguard.
| Criterion | Vendor question | Evidence to request |
|---|---|---|
| Approved-source grounding | Can the agent limit answers to approved knowledge and business data? | Run source-present, source-missing, and conflicting-source test questions. |
| Unknown-answer handling | What happens when the agent cannot verify a useful answer? | Test an intentionally undocumented policy and inspect the resulting action. |
| Human handoff | Can a person claim the case with the transcript, customer context, and next step? | Trigger a live handoff and follow it through assignment and customer reply. |
| Consequential-action approval | Are refunds, cancellations, discounts, and account changes approval-bound? | Attempt one allowed action and one stale, denied, or out-of-scope action. |
| Customer-context access | Can the agent retrieve the minimum verified customer, order, and product context? | Test a product question and an authenticated order question with changed data. |
| Pre-launch testing | Can the team simulate representative conversations before publishing changes? | Run a saved acceptance set before and after a knowledge or policy change. |
| Audit trail | Can operators reconstruct the answer, sources, tools, approvals, and outcome? | Select one completed conversation and request its end-to-end trace. |
| Outcome measurement | Does reporting separate resolved, handed-off, abandoned, corrected, and failed work? | Review metric definitions and reconcile a sample report to conversations. |
| Pricing comparability | Can the buyer model the same support volume across plans, seats, usage, and outcomes? | Price a normal month and a peak month using written billing definitions. |
| Data and access controls | Can access, retention, deletion, and channel permissions be verified? | Inspect role boundaries and complete a test export or deletion workflow. |
1
Choose the recurring questions and channels the agent is allowed to handle.
2
Connect approved support knowledge and verify the customer context the agent may use.
3
Review answers, handoffs, tool traces, and unresolved cases with an operator.
4
Expand permissions only when the evidence supports the next workflow or channel.
Core product scope, channels, pricing, and pilot path.
Model subscriptions, outcome fees, human handling, supervision, and rework.
Grounding, handoff, auditability, and explicit roadmap boundaries.
How outcome evidence becomes buyer-safe public proof.
A same-criteria comparison for support and Shopify teams.
A focused alternative page for support-agent buyers.
A Shopify-specific path for support, catalog, and order context.
Use cases for product, order, returns, and handoff questions.
Check that the agent can answer from approved knowledge, identify when information is missing, hand off to a person with context, and show measurable results before its permissions expand.
It can do both, but consequential actions should use verified context, explicit approval where required, and a durable record that a human can inspect.
A supervised pilot uses a defined scope, live conversations, review checkpoints, and outcome evidence. A free trial usually measures product access rather than whether the agent is safe and useful for a specific support queue.
Hand off when the answer is unverified, the request is sensitive or consequential, the customer asks for a person, or the agent cannot complete the approved workflow confidently.
Review the product scope, trust controls, and benchmark program before deciding which support queue to test first.