{"id":3191,"date":"2022-02-16T07:21:17","date_gmt":"2022-02-16T07:21:17","guid":{"rendered":"https:\/\/multisite.korebots.com\/SearchAssist\/?p=3191"},"modified":"2022-02-24T04:21:37","modified_gmt":"2022-02-24T04:21:37","slug":"launching-experiments","status":"publish","type":"post","link":"https:\/\/multisite.korebots.com\/SearchAssist\/concepts\/experimenting-variants\/launching-experiments\/","title":{"rendered":"Experiments"},"content":{"rendered":"<section class=\"l-section wpb_row height_auto\"><div class=\"l-section-h i-cf\"><div class=\"g-cols vc_row via_grid cols_1 laptops-cols_inherit tablets-cols_inherit mobiles-cols_1 valign_top type_default stacking_default\"><div class=\"wpb_column vc_column_container\"><div class=\"vc_column-inner\"><div class=\"wpb_text_column\"><div class=\"wpb_wrapper\"><h3 class=\"w-post-elm post_title entry-title\"><span class=\"ez-toc-section\" id=\"Adding_Experiments\"><\/span><span id=\"Adding_Experiments\" class=\"ez-toc-section\">Adding Experiments<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"w-post-elm post_content\">\n<section class=\"l-section wpb_row height_auto width_full\">\n<div class=\"l-section-h i-cf\">\n<div class=\"g-cols vc_row type_default valign_top\">\n<div class=\"vc_col-sm-12 wpb_column vc_column_container\">\n<div class=\"vc_column-inner\">\n<div class=\"wpb_wrapper\">\n<div class=\"wpb_text_column \">\n<div class=\"wpb_wrapper\">\n<p>SearchAssist allows you to define the parameters in an experiment and add them to an active Search Assistant. By activating the experiment you are allowing the search query traffic to be split randomly among the variants.<\/p>\n<p>To add an experiment, take the following steps:<\/p>\n<ol>\n<li>Click the\u00a0<b>Analytics\u00a0<\/b>tab on the top and select\u00a0<b>Experiments\u00a0<\/b>from the dropdown.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3324 size-large\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing-1024x182.png\" alt=\"\" width=\"640\" height=\"114\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing-1024x182.png 1024w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing-300x53.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing.png 1900w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><\/li>\n<li>On the Experiments page, click\u00a0<strong>+<\/strong><b>Add Experiment<\/b>\u00a0on the upper-right.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3325 size-large\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing1-1024x204.png\" alt=\"\" width=\"640\" height=\"128\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing1-1024x204.png 1024w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing1-300x60.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing1.png 1898w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><\/li>\n<li>In the View Experiment dialog box, enter a name in the Name of Experiment field.<\/li>\n<li>Click\u00a0<strong>+<\/strong><b>Add Variant<\/b>.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_add-exp_2add_variant.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3326 size-large\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_add-exp_2add_variant-1024x588.png\" alt=\"\" width=\"640\" height=\"368\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_add-exp_2add_variant-1024x588.png 1024w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_add-exp_2add_variant-300x172.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_add-exp_2add_variant.png 1257w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><\/li>\n<li>Enter a name in the Variant Name field.<\/li>\n<li>Select an index configuration from the Index dropdown.<\/li>\n<li>Select a configuration from the Search Configuration dropdown.<\/li>\n<li>Repeat steps\u00a0 4 through 7 for multiple variants upto a maximum of 4.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_exp_3-variants.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3329 size-large\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_exp_3-variants-1024x581.png\" alt=\"\" width=\"640\" height=\"363\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_exp_3-variants-1024x581.png 1024w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_exp_3-variants-300x170.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_exp_3-variants.png 1247w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><br \/>\n<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_4variants1exp.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3330 size-large\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_4variants1exp-1024x594.png\" alt=\"\" width=\"640\" height=\"371\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_4variants1exp-1024x594.png 1024w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_4variants1exp-300x174.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_4variants1exp.png 1265w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><\/li>\n<li>Under the Traffic section, adjust the slider to set a value indicating the percent of the user query traffic to flow through each variant.<\/li>\n<li>In the\u00a0<strong>Duration<\/strong>\u00a0field, enter the number of days the experiment needs to be run, up to a maximum of 90 days.<\/li>\n<li>Click\u00a0<b>Add<\/b>.<\/li>\n<\/ol>\n<\/div>\n<h3 class=\"w-post-elm post_title entry-title\"><span class=\"ez-toc-section\" id=\"Running_Experiments\"><\/span><span id=\"Running_Experiments\" class=\"ez-toc-section\">Running Experiments<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"w-post-elm post_content\">\n<section class=\"l-section wpb_row height_auto width_full\">\n<div class=\"l-section-h i-cf\">\n<div class=\"g-cols vc_row type_default valign_top\">\n<div class=\"vc_col-sm-12 wpb_column vc_column_container\">\n<div class=\"vc_column-inner\">\n<div class=\"wpb_wrapper\">\n<div class=\"wpb_text_column \">\n<div class=\"wpb_wrapper\">\n<p>After adding experiments, you can run the experiments to measure the search results based on the index and search configuration.<\/p>\n<p>To run experiments, take the following steps:<\/p>\n<ol>\n<li>Click the\u00a0<strong>Analytics<\/strong>\u00a0on the top and select\u00a0<strong>Experiments<\/strong>\u00a0from the dropdown.<\/li>\n<li>On the Experiments page, find the list of experiments.<\/li>\n<li>Click\u00a0<strong>Run<\/strong>\u00a0on the respective experiment. Note you can run only one experiment at any given point in time.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_exp_run.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3327 size-large\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_exp_run-1024x259.png\" alt=\"\" width=\"640\" height=\"162\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_exp_run-1024x259.png 1024w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_exp_run-300x76.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_exp_run.png 1901w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><\/li>\n<\/ol>\n<p>After the experiment starts running, the status changes to\u00a0<strong>Active<\/strong>, and the\u00a0<strong>Duration<\/strong>\u00a0is displayed.<\/p>\n<p>Notes:<\/p>\n<ol>\n<li>You cannot run multiple experiments\u00a0with two variants attached to each experiment.<\/li>\n<li>\n<div class=\"info-notifcation ng-star-inserted\"><span class=\"title\">You cannot edit a completed experiment.<\/span><\/div>\n<\/li>\n<\/ol>\n<h3 class=\"w-post-elm post_title entry-title\"><span class=\"ez-toc-section\" id=\"Get_Insights_from_Experiments\"><\/span><span id=\"Managing_Experiments\" class=\"ez-toc-section\">Get Insights from Experiments<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"w-post-elm post_content\">\n<section class=\"l-section wpb_row height_auto width_full\">\n<div class=\"l-section-h i-cf\">\n<div class=\"g-cols vc_row type_default valign_top\">\n<div class=\"vc_col-sm-12 wpb_column vc_column_container\">\n<div class=\"vc_column-inner\">\n<div class=\"wpb_wrapper\">\n<div class=\"wpb_text_column \">\n<div class=\"wpb_wrapper\">\n<p>Once you run an experiment, you can monitor the active experiment in progress by clicking on the experiment. You can\u00a0 view the following analytics and draw insights from the same against a given Variant name<\/p>\n<ol>\n<li style=\"list-style-type: none;\">\n<ol>\n<li>Index assigned<\/li>\n<li>Search configuration mapped<\/li>\n<li>Traffic %ge assigned<\/li>\n<li>Number of users<\/li>\n<li>Number of searches<\/li>\n<li>Count of clicks<\/li>\n<li>Click-through rate for each variant i.e. number of unique clicks per appearances<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<p>Based on the insights drawn from the Experiment metrics you can take informed decisions on which variant to be applied to achieve your desired business objectives.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Managing_Experiments\"><\/span>Managing Experiments<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<ol>\n<li>choose to\u00a0<strong>pause<\/strong>\u00a0or\u00a0<strong>stop<\/strong>\u00a0the experiment.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_associated_actions1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3328 size-large\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_associated_actions1-1024x178.png\" alt=\"\" width=\"640\" height=\"111\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_associated_actions1-1024x178.png 1024w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_associated_actions1-300x52.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/02\/Experiment-with-AB-testing_associated_actions1.png 1905w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><\/li>\n<li><strong>delete<\/strong>\u00a0a paused or stopped experiment.<\/li>\n<li><strong>edit<\/strong>\u00a0the configuration of an experiment that is yet to run.<\/li>\n<\/ol>\n<p>Note: You cannot edit a completed experiment.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<\/div><\/div><\/div><\/div><\/div><\/div><\/section><section class=\"l-section wpb_row height_auto\"><div class=\"l-section-h i-cf\"><div class=\"g-cols vc_row via_grid cols_1 laptops-cols_inherit tablets-cols_inherit mobiles-cols_1 valign_top type_default stacking_default\"><div class=\"wpb_column vc_column_container\"><div class=\"vc_column-inner\"><div class=\"w-post-elm post_navigation layout_simple inv_false\"><a class=\"post_navigation-item order_first to_prev\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/quick-start\/use-cases\/overview-uc1\/\" title=\"Overview\"><div class=\"post_navigation-item-arrow\"><\/div><div class=\"post_navigation-item-meta\">Previous Post<\/div><div class=\"post_navigation-item-title\"><span>Overview<\/span><\/div><\/a><a class=\"post_navigation-item order_second to_next\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/searchassist\/overview\/\" title=\"Overview\"><div class=\"post_navigation-item-arrow\"><\/div><div class=\"post_navigation-item-meta\">Next Post<\/div><div class=\"post_navigation-item-title\"><span>Overview<\/span><\/div><\/a><\/div><\/div><\/div><\/div><\/div><\/section>\n","protected":false},"excerpt":{"rendered":"Adding Experiments SearchAssist allows you to define the parameters in an experiment and add them to an active Search Assistant. By activating the experiment you are allowing the search query traffic to be split randomly among the variants. To add an experiment, take the following steps: Click the\u00a0Analytics\u00a0tab on the top and select\u00a0Experiments\u00a0from the dropdown....","protected":false},"author":18,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[78],"tags":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts\/3191"}],"collection":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/comments?post=3191"}],"version-history":[{"count":11,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts\/3191\/revisions"}],"predecessor-version":[{"id":3595,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts\/3191\/revisions\/3595"}],"wp:attachment":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/media?parent=3191"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/categories?post=3191"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/tags?post=3191"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}