{"id":10904,"date":"2026-03-27T18:39:28","date_gmt":"2026-03-28T00:39:28","guid":{"rendered":"https:\/\/attentionmedia.io\/?p=10904"},"modified":"2026-03-27T18:39:28","modified_gmt":"2026-03-28T00:39:28","slug":"the-email-metrics-marketers-are-likely-to-get-wrong","status":"publish","type":"post","link":"https:\/\/attentionmedia.io\/?p=10904","title":{"rendered":"The email metrics marketers are likely to get wrong"},"content":{"rendered":"<div><img loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"533\" src=\"https:\/\/martech.org\/wp-content\/uploads\/2025\/09\/ChatGPT-Image-Sep-30-2025-02_43_06-PM-800x533.png\" class=\"attachment-large size-large wp-post-image\" alt=\"\" loading=\"lazy\" \/><\/div>\n<p>Open rate. Click-through rate. Ask most marketing teams how their email program is performing, and those are the numbers they\u2019ll show you.<\/p>\n<p>But here\u2019s the problem: Open and click metrics don\u2019t tell you whether your email program is actually working. They tell you how people interacted with the email message, not whether the email generated meaningful results for the business.<\/p>\n<p>Relying on them as key performance indicators (KPIs) can lead to optimizing for the wrong outcomes entirely.\u00a0<\/p>\n<h2 class=\"wp-block-heading\">What the data shows about open and click rates<\/h2>\n<p>I\u2019ve seen subject line A\/B split tests where the version with the highest open rate produced fewer conversions or lower revenue per email (RPE) than the other versions. I\u2019ve also seen campaigns where the version with the highest click-through rate generated fewer conversions or lower RPE than the other versions.<\/p>\n<p>This isn\u2019t just anecdotal. Looking across subject line tests I\u2019ve conducted for a wide range of clients and audiences over many years, the results are striking.<\/p>\n<p><a href=\"https:\/\/www.semrush.com\/lp\/semrush-one\/en\/?utm_campaign=ic_semrush_one&amp;utm_source=searchengineland.com&amp;utm_medium=overlay&amp;onboarding=off\" target=\"_blank\"><\/a><\/p>\n<div>\n<div>\n<div class=\"headline-responsive\">\n        Your customers search everywhere. Make sure your brand <span>shows up<\/span>.\n      <\/div>\n<p>\n        The SEO toolkit you know, plus the AI visibility data you need.\n      <\/p>\n<\/div>\n<div>\n      <span>Start Free Trial<\/span>\n    <\/div>\n<div>\n<div>Get started with<\/div>\n<p>      <img decoding=\"async\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp\" alt=\"Semrush One Logo\" \/>\n    <\/p><\/div>\n<\/div>\n<p><\/p>\n<h3 class=\"wp-block-heading\">Open rate as a KPI: Rarely useful<\/h3>\n<p>Many marketing teams use open rate as the primary KPI for subject line tests. After all, the subject line affects whether someone opens the email. But if your business goal is conversions or revenue, open rate is a weak proxy.<\/p>\n<p>Across subject line A\/B tests I\u2019ve conducted using the <a href=\"https:\/\/martech.org\/applying-scientific-method-to-performance\/\" target=\"_blank\" rel=\"noopener\">scientific method<\/a>, I went back to see how often the highest open rate was a correct predictor of the version with the highest conversion rate (for non-revenue actions) or RPE.\u00a0<\/p>\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" loading=\"lazy\" width=\"1400\" height=\"900\" src=\"https:\/\/martech.org\/wp-content\/uploads\/2026\/03\/Open-rate-as-a-KPI-Rarely-useful.png\" alt=\"Open rate as a KPI: Rarely useful\" class=\"wp-image-407187\" \/><\/figure>\n<\/div>\n<p>The data suggests that if your marketing department relies on open rate as a KPI for your subject line testing:\u00a0<\/p>\n<ul class=\"wp-block-list\">\n<li>20% of the time, your results will correctly identify the version with the highest conversion rate or RPE.\u00a0<\/li>\n<li>10% of the time, your results will not correctly identify the highest-converting RPR version.\u00a0<\/li>\n<li>70% of the time, your open rate variance will fall within the margin of error and therefore be inconclusive, even when a clear highest-conversion-rate or RPE version exists.\u00a0<\/li>\n<\/ul>\n<p>Open rate either misled the analysis or provided no useful insight in 80% of the tests.<\/p>\n<h3 class=\"wp-block-heading\">Click-through rate is even worse<\/h3>\n<p>If open rate isn\u2019t a reliable KPI, some turn to click-through rate instead. That seems reasonable: clicks occur later in the funnel, so they should correlate more closely with conversions or revenue.<\/p>\n<p>Unfortunately, the data suggests otherwise. Across campaign tests comparing CTR to conversion rate or revenue-per-email, the results of my analysis looked like this:<\/p>\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" loading=\"lazy\" width=\"800\" height=\"514\" src=\"https:\/\/martech.org\/wp-content\/uploads\/2026\/03\/Click-through-rate-is-even-worse-800x514.png\" alt=\"Click-through rate is even worse\" class=\"wp-image-407188\" \/><\/figure>\n<\/div>\n<p>In this case:\u00a0<\/p>\n<ul class=\"wp-block-list\">\n<li>Only 7% of the time did the highest CTR version also produce the highest conversion rate or RPE.<\/li>\n<li>36% of the time, CTR pointed to the wrong winner.<\/li>\n<li>57% of the time, CTR differences weren\u2019t statistically significant, even though the business metrics clearly were.<\/li>\n<\/ul>\n<p>CTR was a reliable indicator of the true winner only 7% of the time.<\/p>\n<h2 class=\"wp-block-heading\">The metrics that actually measure email performance<\/h2>\n<p>Diagnostic metrics like opens and clicks don\u2019t reliably predict business outcomes. If you want to accurately evaluate email performance, you need to look at metrics that measure actual results.<\/p>\n<p>Two of the most important are conversion rate and revenue per email.<\/p>\n<h3 class=\"wp-block-heading\">Conversion rate: The metric that shows whether email works<\/h3>\n<p><a href=\"https:\/\/martech.org\/use-conversion-rate-as-your-key-email-marketing-metric\/\" target=\"_blank\" rel=\"noopener\">Conversion rate<\/a> measures the percentage of recipients who complete the action your email was designed to drive. A conversion doesn\u2019t have to be a sale. It can be a purchase, a demo request, a webinar registration, a lead generation form, an app download or a subscription renewal.<\/p>\n<p>Here\u2019s the formula:<\/p>\n<ul class=\"wp-block-list\">\n<li><strong>Conversion rate = Conversions \u00f7 (Number of emails sent \u2013 Bounces)<\/strong>\n<ul class=\"wp-block-list\">\n<li>Multiply by 100 to express it as a percentage.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>Conversion rate directly measures whether your email campaign is achieving its goal. It answers the most important question: Did the email cause the behavior we wanted?<\/p>\n<p>This is why conversion rate is often the best KPI for campaigns designed to drive actions rather than immediate revenue.<\/p>\n<h3 class=\"wp-block-heading\">Revenue per email: The metric that proves email ROI<\/h3>\n<p>For ecommerce programs, the metric I care about most is RPE.\u00a0<\/p>\n<ul class=\"wp-block-list\">\n<li><strong>Revenue per email = Total revenue \u00f7 (Number of emails sent \u2013 Bounces)<\/strong>\n<ul class=\"wp-block-list\">\n<li>We present this metric as a dollar figure.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>Unlike clicks or opens, this metric directly ties email performance to financial outcomes. It often reveals insights that engagement metrics hide.<\/p>\n<p>For example, I once spoke with a company that sells high-end audio equipment. They had an aggressive A\/B testing program and ran a test on whether to include product prices in their email. They used click-through rate as the KPI. Here were the results.<\/p>\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" loading=\"lazy\" width=\"800\" height=\"514\" src=\"https:\/\/martech.org\/wp-content\/uploads\/2026\/03\/CTR-AB-test-split.png\" alt=\"CTR AB test split\" class=\"wp-image-407189\" \/><\/figure>\n<\/div>\n<p>The version without pricing generated significantly more clicks, so it was declared the winner. But think about what\u2019s happening here. High-end audio equipment is expensive. Many recipients likely clicked simply to find out the price. If the price had been included in the email, as it was in the control version, those recipients wouldn\u2019t have needed to click.<\/p>\n<p>The higher CTR version may simply have generated more curiosity clicks, not more clicks from qualified buyers. Because the company wasn\u2019t tracking conversions or revenue back to email, they couldn\u2019t determine which version actually generated more sales. <\/p>\n<p>Without that data, the test winner is questionable at best.<\/p>\n<h2 class=\"wp-block-heading\">The real lesson for email marketers<\/h2>\n<p>Open rates and click-through rates aren\u2019t useless. They\u2019re valuable diagnostic metrics that help you understand how recipients interact with your email content.<\/p>\n<p>But they shouldn\u2019t be the primary KPIs for most email programs. If your goal is conversions or revenue, and for most businesses it is, then your performance metrics should measure those outcomes directly.<\/p>\n<p>That means focusing on:<\/p>\n<ul class=\"wp-block-list\">\n<li>Conversion rate to measure whether your campaigns drive the desired action.<\/li>\n<li>Revenue per email to measure the financial impact of your program.<\/li>\n<\/ul>\n<p>Because in the end, opens and clicks don\u2019t make a campaign successful, outcomes do.<\/p>\n<p><strong><em>Author\u2019s note: <\/em><\/strong><em>AI tools were used to assist with drafting and editing portions of this article. The testing data, analysis, and conclusions are based on subject line and campaign tests conducted for client email programs over multiple years.<\/em><\/p>\n<p>The post <a href=\"https:\/\/martech.org\/the-email-metrics-marketers-are-likely-to-get-wrong\/\">The email metrics marketers are likely to get wrong<\/a> appeared first on <a href=\"https:\/\/martech.org\/\">MarTech<\/a>.<\/p>","protected":false},"excerpt":{"rendered":"<p>Open rate. Click-through rate. Ask most marketing teams how their email program is performing, and those are the numbers they\u2019ll show you. But here\u2019s the problem: Open and click metrics don\u2019t tell you whether your email program is actually working. They tell you how people interacted with the email message, not whether the email generated &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/attentionmedia.io\/?p=10904\" class=\"more-link\">Read more<span class=\"screen-reader-text\"> &#8220;The email metrics marketers are likely to get wrong&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-10904","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"featured_media_urls":{"thumbnail":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"medium":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"medium_large":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"large":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"1536x1536":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"2048x2048":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"inspiro-featured-image":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"inspiro-loop":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"inspiro-loop@2x":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"portfolio_item-thumbnail":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"portfolio_item-thumbnail@2x":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"portfolio_item-masonry":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"portfolio_item-masonry@2x":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"portfolio_item-thumbnail_cinema":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"portfolio_item-thumbnail_portrait":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"portfolio_item-thumbnail_portrait@2x":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false],"portfolio_item-thumbnail_square":["https:\/\/martech.org\/searchengineland.com\/wp-content\/seloads\/2025\/11\/semrush-one.webp",0,0,false]},"_links":{"self":[{"href":"https:\/\/attentionmedia.io\/index.php?rest_route=\/wp\/v2\/posts\/10904","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/attentionmedia.io\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/attentionmedia.io\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/attentionmedia.io\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/attentionmedia.io\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=10904"}],"version-history":[{"count":0,"href":"https:\/\/attentionmedia.io\/index.php?rest_route=\/wp\/v2\/posts\/10904\/revisions"}],"wp:attachment":[{"href":"https:\/\/attentionmedia.io\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=10904"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/attentionmedia.io\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=10904"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/attentionmedia.io\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=10904"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}