{"id":2675,"date":"2023-03-23T11:48:53","date_gmt":"2023-03-23T10:48:53","guid":{"rendered":"https:\/\/thedatastory.nl\/?p=2675"},"modified":"2025-09-17T17:09:03","modified_gmt":"2025-09-17T15:09:03","slug":"product-experimenting-which-test-should-you-choose","status":"publish","type":"post","link":"https:\/\/thedatastory.nl\/en\/data-stories\/product-experimenting-which-test-should-you-choose\/","title":{"rendered":"Product experimenting: which test should you choose?"},"content":{"rendered":"<p>Navigating the world of Product experimenting can sometimes be challenging. Which test should you choose? How many users should you have in it? How do you make sure your results are conclusive?<\/p>\n\n\n\n<p>Part 1 of our data analyst&#8217;s guide to product experimentation: Choosing the right test for you. In this article, 3 different ways to perform product experiments will be discussed:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A\/B testing<\/li>\n\n\n\n<li>Multivariate testing<\/li>\n\n\n\n<li>Multi-armed bandit testing<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>What is A\/B testing?<\/strong><\/h2>\n\n\n\n<p>A\/B testing is an experiment in which two or more variations of a page are shown to users at random. Statistical analysis is then used to determine which of them performs better. We measure their performance by considering one or multiple conversion goals, as well as whether a possible improvement is statistically significant. Examples of conversion goals are purchases, clicks and subscriptions.<\/p>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<p>A\/B testing is an experiment in which two or more variations of a page are shown to users at random. Statistical analysis is then used to determine which of them performs better. We measure their performance by considering one or multiple conversion goals, as well as whether a possible improvement is statistically significant. Examples of conversion goals are purchases, clicks and subscriptions.<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-full is-resized\"><img fetchpriority=\"high\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"http:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-from-AB-Test.jpg\" alt=\"Product experimenting experiment A\/B test\" class=\"wp-image-3713\" style=\"width:292px;height:279px\" srcset=\"https:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-from-AB-Test.jpg 1024w, https:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-from-AB-Test-300x300.jpg 300w, https:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-from-AB-Test-150x150.jpg 150w, https:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-from-AB-Test-768x768.jpg 768w, https:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-from-AB-Test-12x12.jpg 12w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n<\/div>\n\n\n\n<h3 class=\"wp-block-heading\">A\/B testing is useful in 2 types of situations:<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>When you want to test 2 very different design directions against each other.<\/li>\n\n\n\n<li>When one element of the page is up for debate.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">A\/B testing \u2013 Pros and Cons<\/h3>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>Pros<\/strong><\/td><td><strong>Cons<\/strong><\/td><\/tr><tr><td>&#8211; Simple to design and execute<br>&#8211; Statistically robust with smaller traffic<br>&#8211; Provides results that are easier for non-quantitative business teams to interpret and implement<\/td><td>&#8211; Limited to a single variable and a few variants of that variable<br>&#8211; Not possible to study the interaction between multiple variables within the same campaign<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>What is Multivariate testing?<\/strong><\/h2>\n\n\n\n<p>The main difference between A\/B and Multivariate testing is that the latter compares a higher number of variables. Hence, it gives us more information on how variables interact with one another. The purpose of Multivariate testing is to measure the impact of each design combination on the final goal.<\/p>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<p class=\"has-text-align-left\">Once a site has received enough traffic to run the test, the data from each variation is compared. This will then indicate which design combination is the most successful. Besides, it also reveals which elements are most responsible for the performance of a combination. This provides us with the possibility to see if there are any elements that jump out and have an extraordinarily significant impact.<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-full is-resized\"><img decoding=\"async\" width=\"1024\" height=\"1024\" src=\"https:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-A-B-Test.jpg\" alt=\"Product experimenting\" class=\"wp-image-3715\" style=\"width:475px;height:291px\" srcset=\"https:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-A-B-Test.jpg 1024w, https:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-A-B-Test-300x300.jpg 300w, https:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-A-B-Test-150x150.jpg 150w, https:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-A-B-Test-768x768.jpg 768w, https:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-A-B-Test-12x12.jpg 12w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n<\/div>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>When to use Multivariate testing?<\/strong><\/h3>\n\n\n\n<p>The most common use case for Multivariate testing is a page on which many elements are up for debate. Multivariate testing is only recommended for a site that has a substantial amount of daily traffic: the more variations that need to be tested, the longer it takes to produce meaningful data.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Multivariate testing \u2013 Pros and Cons<\/strong><\/h3>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>Pros<\/strong><\/td><td><strong>Cons<\/strong><\/td><\/tr><tr><td>&#8211; Provides insights into interactions between multiple variables<br>&#8211; Helps identify which elements impact the performance<br>&#8211; Allow to compare many different versions of a page<\/td><td>&#8211; Requires more traffic than A\/B testing<br>&#8211; Can become unmanageable as amount of combinations grows<br>&#8211; Can take more time to get up and running<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>What is Multi-armed bandit testing?<\/strong><\/h2>\n\n\n\n<p>Multi-armed bandit is a type of testing that uses machine learning. It learns from data collected during the test and uses its new knowledge to dynamically allocate visitors. Its goal is to allocate users in such a way that better-performing variations continue to perform better and better. The flip side of this is that less-performing variations get less and less traffic allocation over time. This type of testing is particularly useful when you cannot afford to lose any conversion.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">You should use Multi-armed bandit testing when:<strong>&nbsp;<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The opportunity\/cost of loss is too high. For instance when selling diamonds or cars, a loss of conversion can cost thousands.<\/li>\n\n\n\n<li>Optimizing click-through rates. For news outlets that cover time-sensitive events for example, the short shelf life of news pieces means that quick optimization is essential.&nbsp;<\/li>\n\n\n\n<li>Optimizing revenue with low traffic. If there is not enough traffic, A\/B tests can take really long to produce statistical significance. In these cases, businesses may find it best to run Multi-armed bandit testing to be able to detect the potentially best version much earlier. This way, they can immediately capitalize on this discovery by directing an increasing amount of traffic to it.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>A\/B testing VS Multi-armed bandit testing<\/strong><\/h2>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>A\/B testing<\/strong><\/td><td><strong>Multi-armed bandit testing<\/strong><\/td><\/tr><tr><td>&#8211; Goal is to collect data to make a critical business decision<br>&#8211; Goal is to see the impact of each variation with statistical confidence<\/td><td>&#8211; No need for interpretation of performance of variations &#8211; the goal here is to maximize conversions<br>&#8211; The window of opportunity for optimization is short-lived<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>We hope this product experimenting blog will help you along! Feel like reading <a href=\"https:\/\/thedatastory.nl\/en\/data-stories\/\" target=\"_blank\" rel=\"noreferrer noopener\">more data stories?<\/a>&nbsp;Then take a look at our <a href=\"https:\/\/thedatastory.nl\/en\/data-stories\/\" target=\"_blank\" rel=\"noreferrer noopener\">blog page.<\/a> Always want to stay up to date? Then be sure to follow us on <a href=\"https:\/\/www.linkedin.com\/company\/the-data-story\">LinkedIn<\/a>. <\/p>\n\n\n\n<p><\/p>","protected":false},"excerpt":{"rendered":"<p>Navigating the world of Product experimenting can sometimes be challenging. Which test should you choose? How many users should you have in it? How do you make sure your results [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":3713,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_price":"","_stock":"","_tribe_ticket_header":"","_tribe_default_ticket_provider":"","_tribe_ticket_capacity":"0","_ticket_start_date":"","_ticket_end_date":"","_tribe_ticket_show_description":"","_tribe_ticket_show_not_going":false,"_tribe_ticket_use_global_stock":"","_tribe_ticket_global_stock_level":"","_global_stock_mode":"","_global_stock_cap":"","_tribe_rsvp_for_event":"","_tribe_ticket_going_count":"","_tribe_ticket_not_going_count":"","_tribe_tickets_list":"[]","_tribe_ticket_has_attendee_info_fields":false,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-2675","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-stories"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Product experimenting: which test should you choose? - The Data Story<\/title>\n<meta name=\"description\" content=\"Our data analyst&#039;s guide to Product experimenting : Which test should you choose? How do you make sure your results are conclusive?\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/thedatastory.nl\/en\/data-stories\/product-experimenting-which-test-should-you-choose\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Product experimenting: which test should you choose? - The Data Story\" \/>\n<meta property=\"og:description\" content=\"Our data analyst&#039;s guide to Product experimenting : Which test should you choose? How do you make sure your results are conclusive?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/thedatastory.nl\/en\/data-stories\/product-experimenting-which-test-should-you-choose\/\" \/>\n<meta property=\"og:site_name\" content=\"The Data Story\" \/>\n<meta property=\"article:published_time\" content=\"2023-03-23T10:48:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-09-17T15:09:03+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-from-AB-Test.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"1024\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"The Data Story\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"The Data Story\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/data-stories\\\/product-experimenting-which-test-should-you-choose\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/data-stories\\\/product-experimenting-which-test-should-you-choose\\\/\"},\"author\":{\"name\":\"The Data Story\",\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/en\\\/#\\\/schema\\\/person\\\/e218295bc2730947de16723cb69d18f3\"},\"headline\":\"Product experimenting: which test should you choose?\",\"datePublished\":\"2023-03-23T10:48:53+00:00\",\"dateModified\":\"2025-09-17T15:09:03+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/data-stories\\\/product-experimenting-which-test-should-you-choose\\\/\"},\"wordCount\":833,\"publisher\":{\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/en\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/data-stories\\\/product-experimenting-which-test-should-you-choose\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/thedatastory.nl\\\/wp-content\\\/uploads\\\/2023\\\/03\\\/ChatGPT-Image-Sept-17-2025-from-AB-Test.jpg\",\"articleSection\":[\"Data stories\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/data-stories\\\/product-experimenting-which-test-should-you-choose\\\/\",\"url\":\"https:\\\/\\\/thedatastory.nl\\\/data-stories\\\/product-experimenting-which-test-should-you-choose\\\/\",\"name\":\"Product experimenting: which test should you choose? - The Data Story\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/data-stories\\\/product-experimenting-which-test-should-you-choose\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/data-stories\\\/product-experimenting-which-test-should-you-choose\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/thedatastory.nl\\\/wp-content\\\/uploads\\\/2023\\\/03\\\/ChatGPT-Image-Sept-17-2025-from-AB-Test.jpg\",\"datePublished\":\"2023-03-23T10:48:53+00:00\",\"dateModified\":\"2025-09-17T15:09:03+00:00\",\"description\":\"Our data analyst's guide to Product experimenting : Which test should you choose? How do you make sure your results are conclusive?\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/data-stories\\\/product-experimenting-which-test-should-you-choose\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/thedatastory.nl\\\/data-stories\\\/product-experimenting-which-test-should-you-choose\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/data-stories\\\/product-experimenting-which-test-should-you-choose\\\/#primaryimage\",\"url\":\"https:\\\/\\\/thedatastory.nl\\\/wp-content\\\/uploads\\\/2023\\\/03\\\/ChatGPT-Image-Sept-17-2025-from-AB-Test.jpg\",\"contentUrl\":\"https:\\\/\\\/thedatastory.nl\\\/wp-content\\\/uploads\\\/2023\\\/03\\\/ChatGPT-Image-Sept-17-2025-from-AB-Test.jpg\",\"width\":1024,\"height\":1024,\"caption\":\"Product experimenting experiment A\\\/B test\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/data-stories\\\/product-experimenting-which-test-should-you-choose\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/thedatastory.nl\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Data stories\",\"item\":\"https:\\\/\\\/thedatastory.nl\\\/en\\\/data-stories\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Product experimenting: which test should you choose?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/thedatastory.nl\\\/en\\\/\",\"name\":\"The Data Story\",\"description\":\"Data Analyse, Visualisatie &amp; Automation\",\"publisher\":{\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/thedatastory.nl\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/en\\\/#organization\",\"name\":\"The Data Story\",\"url\":\"https:\\\/\\\/thedatastory.nl\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/thedatastory.nl\\\/wp-content\\\/uploads\\\/2021\\\/11\\\/Logo-negatief.svg\",\"contentUrl\":\"https:\\\/\\\/thedatastory.nl\\\/wp-content\\\/uploads\\\/2021\\\/11\\\/Logo-negatief.svg\",\"width\":250,\"height\":49,\"caption\":\"The Data Story\"},\"image\":{\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/thedatastory.nl\\\/en\\\/#\\\/schema\\\/person\\\/e218295bc2730947de16723cb69d18f3\",\"name\":\"The Data Story\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3b7086714fe59d0954156d3cedeeaf914f3630d097c0c9587f9fb4793ce63818?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3b7086714fe59d0954156d3cedeeaf914f3630d097c0c9587f9fb4793ce63818?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3b7086714fe59d0954156d3cedeeaf914f3630d097c0c9587f9fb4793ce63818?s=96&d=mm&r=g\",\"caption\":\"The Data Story\"},\"url\":\"https:\\\/\\\/thedatastory.nl\\\/en\\\/author\\\/the-data-story\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Product experimenting: which test should you choose? - The Data Story","description":"Our data analyst's guide to Product experimenting : Which test should you choose? How do you make sure your results are conclusive?","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/thedatastory.nl\/en\/data-stories\/product-experimenting-which-test-should-you-choose\/","og_locale":"en_US","og_type":"article","og_title":"Product experimenting: which test should you choose? - The Data Story","og_description":"Our data analyst's guide to Product experimenting : Which test should you choose? How do you make sure your results are conclusive?","og_url":"https:\/\/thedatastory.nl\/en\/data-stories\/product-experimenting-which-test-should-you-choose\/","og_site_name":"The Data Story","article_published_time":"2023-03-23T10:48:53+00:00","article_modified_time":"2025-09-17T15:09:03+00:00","og_image":[{"width":1024,"height":1024,"url":"http:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-from-AB-Test.jpg","type":"image\/jpeg"}],"author":"The Data Story","twitter_card":"summary_large_image","twitter_misc":{"Written by":"The Data Story","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/thedatastory.nl\/data-stories\/product-experimenting-which-test-should-you-choose\/#article","isPartOf":{"@id":"https:\/\/thedatastory.nl\/data-stories\/product-experimenting-which-test-should-you-choose\/"},"author":{"name":"The Data Story","@id":"https:\/\/thedatastory.nl\/en\/#\/schema\/person\/e218295bc2730947de16723cb69d18f3"},"headline":"Product experimenting: which test should you choose?","datePublished":"2023-03-23T10:48:53+00:00","dateModified":"2025-09-17T15:09:03+00:00","mainEntityOfPage":{"@id":"https:\/\/thedatastory.nl\/data-stories\/product-experimenting-which-test-should-you-choose\/"},"wordCount":833,"publisher":{"@id":"https:\/\/thedatastory.nl\/en\/#organization"},"image":{"@id":"https:\/\/thedatastory.nl\/data-stories\/product-experimenting-which-test-should-you-choose\/#primaryimage"},"thumbnailUrl":"https:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-from-AB-Test.jpg","articleSection":["Data stories"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/thedatastory.nl\/data-stories\/product-experimenting-which-test-should-you-choose\/","url":"https:\/\/thedatastory.nl\/data-stories\/product-experimenting-which-test-should-you-choose\/","name":"Product experimenting: which test should you choose? - The Data Story","isPartOf":{"@id":"https:\/\/thedatastory.nl\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/thedatastory.nl\/data-stories\/product-experimenting-which-test-should-you-choose\/#primaryimage"},"image":{"@id":"https:\/\/thedatastory.nl\/data-stories\/product-experimenting-which-test-should-you-choose\/#primaryimage"},"thumbnailUrl":"https:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-from-AB-Test.jpg","datePublished":"2023-03-23T10:48:53+00:00","dateModified":"2025-09-17T15:09:03+00:00","description":"Our data analyst's guide to Product experimenting : Which test should you choose? How do you make sure your results are conclusive?","breadcrumb":{"@id":"https:\/\/thedatastory.nl\/data-stories\/product-experimenting-which-test-should-you-choose\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/thedatastory.nl\/data-stories\/product-experimenting-which-test-should-you-choose\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/thedatastory.nl\/data-stories\/product-experimenting-which-test-should-you-choose\/#primaryimage","url":"https:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-from-AB-Test.jpg","contentUrl":"https:\/\/thedatastory.nl\/wp-content\/uploads\/2023\/03\/ChatGPT-Image-Sept-17-2025-from-AB-Test.jpg","width":1024,"height":1024,"caption":"Product experimenting experiment A\/B test"},{"@type":"BreadcrumbList","@id":"https:\/\/thedatastory.nl\/data-stories\/product-experimenting-which-test-should-you-choose\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/thedatastory.nl\/en\/"},{"@type":"ListItem","position":2,"name":"Data stories","item":"https:\/\/thedatastory.nl\/en\/data-stories\/"},{"@type":"ListItem","position":3,"name":"Product experimenting: which test should you choose?"}]},{"@type":"WebSite","@id":"https:\/\/thedatastory.nl\/en\/#website","url":"https:\/\/thedatastory.nl\/en\/","name":"The Data Story","description":"Data Analyse, Visualisatie &amp; Automation","publisher":{"@id":"https:\/\/thedatastory.nl\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/thedatastory.nl\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/thedatastory.nl\/en\/#organization","name":"The Data Story","url":"https:\/\/thedatastory.nl\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/thedatastory.nl\/en\/#\/schema\/logo\/image\/","url":"https:\/\/thedatastory.nl\/wp-content\/uploads\/2021\/11\/Logo-negatief.svg","contentUrl":"https:\/\/thedatastory.nl\/wp-content\/uploads\/2021\/11\/Logo-negatief.svg","width":250,"height":49,"caption":"The Data Story"},"image":{"@id":"https:\/\/thedatastory.nl\/en\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/thedatastory.nl\/en\/#\/schema\/person\/e218295bc2730947de16723cb69d18f3","name":"The Data Story","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/3b7086714fe59d0954156d3cedeeaf914f3630d097c0c9587f9fb4793ce63818?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/3b7086714fe59d0954156d3cedeeaf914f3630d097c0c9587f9fb4793ce63818?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/3b7086714fe59d0954156d3cedeeaf914f3630d097c0c9587f9fb4793ce63818?s=96&d=mm&r=g","caption":"The Data Story"},"url":"https:\/\/thedatastory.nl\/en\/author\/the-data-story\/"}]}},"_links":{"self":[{"href":"https:\/\/thedatastory.nl\/en\/wp-json\/wp\/v2\/posts\/2675","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/thedatastory.nl\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thedatastory.nl\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thedatastory.nl\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/thedatastory.nl\/en\/wp-json\/wp\/v2\/comments?post=2675"}],"version-history":[{"count":8,"href":"https:\/\/thedatastory.nl\/en\/wp-json\/wp\/v2\/posts\/2675\/revisions"}],"predecessor-version":[{"id":3716,"href":"https:\/\/thedatastory.nl\/en\/wp-json\/wp\/v2\/posts\/2675\/revisions\/3716"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/thedatastory.nl\/en\/wp-json\/wp\/v2\/media\/3713"}],"wp:attachment":[{"href":"https:\/\/thedatastory.nl\/en\/wp-json\/wp\/v2\/media?parent=2675"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thedatastory.nl\/en\/wp-json\/wp\/v2\/categories?post=2675"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thedatastory.nl\/en\/wp-json\/wp\/v2\/tags?post=2675"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}