{"id":3954,"date":"2022-04-29T06:22:35","date_gmt":"2022-04-29T06:22:35","guid":{"rendered":"https:\/\/multisite.korebots.com\/SearchAssist\/?p=3954"},"modified":"2022-04-29T06:22:35","modified_gmt":"2022-04-29T06:22:35","slug":"experimenting-with-search-variants","status":"publish","type":"post","link":"https:\/\/multisite.korebots.com\/SearchAssist\/concepts\/experimenting-with-variants\/experimenting-with-search-variants\/","title":{"rendered":"Experimenting with Search Variants"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">You can evaluate the performance of your SearchAssist app by running an A\/B test to compare index and search configuration variations. A variant in this context is a unique combination of index and search configurations assigned to one SearchAssist app.\u00a0 The SearchAssist platform lets you quickly set up and run experiments to continuously test variations and improve search relevance.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Consider the following scenarios:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Scenario 1<\/b><span style=\"font-weight: 400;\">\u00a0 You configured an index, and tuned search configurations to optimize search results. You have run it against test data in a controlled environment, but will these settings work with real-time data?\u00a0\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Scenario 2<\/b><span style=\"font-weight: 400;\"> You deployed a SearchAssist app and analyzed its performance. You want to tweak the index and\/or search configuration. You clone the existing configuration and make the necessary changes. How can you make sure these changes lead to better search results?<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">Using Experiments, you can find the most effective index and search configuration combination. Each experiment can hold up to four variants (A, B, C, and D) and split traffic flow randomly among them and for a fixed period. SearchAssist helps you:\u00a0<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">create up to 4 variants using unique combinations of previously created indices and search configurations<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">run live tests in the same SearchAssist app by equally splitting live traffic among the variants<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">evaluate variant performance\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">measure outcomes on metrics like clicks and click-through rates<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">Internally, every search is associated with a unique user identifier. This serves two purposes:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Ensuring randomness, SearchAssist creates sets of users for each variant. New users are randomly routed into one of the variants, based on a hash of their unique user identifier.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Each user continues with the same assigned variant for the duration of the experiment, thus ensuring test reliability.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">SearchAssist gives you granular control over an experiment by:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">specifying the percent of traffic flow throughput rate diverted to each variant, and\/or<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">setting the duration of an experiment.<\/span><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>You can evaluate the performance of your SearchAssist app by running an A\/B test to compare index and search configuration variations. A variant in this context is a unique combination of index and search configurations assigned to one SearchAssist app.\u00a0 The SearchAssist platform lets you quickly set up and run experiments to continuously test variations&#8230;<\/p>\n","protected":false},"author":18,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[97],"tags":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts\/3954"}],"collection":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/comments?post=3954"}],"version-history":[{"count":1,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts\/3954\/revisions"}],"predecessor-version":[{"id":3955,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts\/3954\/revisions\/3955"}],"wp:attachment":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/media?parent=3954"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/categories?post=3954"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/tags?post=3954"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}