Measuring chat conversion: the metrics that actually matter
Chat vendors love dashboards: conversations, messages, “engagement”. The problem is you can have a thousand conversations a month and zero sales from them. Here are the metrics that describe what you actually care about — and the traps in reading them.
The master metric: revenue from conversations
One question sorts everything: how much order value passed through a bot conversation? Technically this requires attribution — linking an order to a prior conversation — and it's the feature to ask any vendor about first. With us it's the standard report: orders from conversations, counted in real money.
The trap: attribution can be counted too generously (“the customer once opened the chat”). Ask what “an order from a conversation” means exactly — the honest definition is a product conversation followed by a purchase, not a glimpse of the chat bubble.
Supporting metrics: closures and escalations
The second layer is three numbers. The share of conversations the bot closed without a human — measures your time saved. The share escalated to a human — not bad in itself (hard cases SHOULD reach you), but a sudden rise signals the bot has stopped keeping up with the store. And the number of conversations ending with contact details left — for services, that's the equivalent of a cart.
Read them together: a high closure rate with zero revenue means the bot answers questions well but doesn't lead to checkout — then you look at whether it's showing products in the conversation.
The ritual: 20 minutes a week
Metrics say “what”; conversations say “why”. Once a week, read a dozen conversations: the three longest, three escalated to a human, and a few random ones. You're looking for two things — questions the bot had no good answer to (data gaps), and moments where the customer gave up (process gaps).
This ritual is the cheapest store optimization we know: 20 minutes a week yields a list of concrete fixes — to product descriptions, to policies, to the bot itself. And if we manage your bot, we do this ritual for you and bring you the conclusions.
CartBot for your platform: WooCommerce · Shopify · PrestaShop · Shoper