{"id":1851,"date":"2022-01-07T07:29:07","date_gmt":"2022-01-07T07:29:07","guid":{"rendered":"https:\/\/multisite.korebots.com\/SearchAssist\/?p=1851"},"modified":"2022-03-01T07:59:37","modified_gmt":"2022-03-01T07:59:37","slug":"configure-workbench","status":"publish","type":"post","link":"https:\/\/multisite.korebots.com\/SearchAssist\/concepts\/managing-indices\/configuring-workbench\/configure-workbench\/","title":{"rendered":"Managing Indexing Pipeline"},"content":{"rendered":"<section class=\"l-section wpb_row height_auto\"><div class=\"l-section-h i-cf\"><div class=\"g-cols vc_row via_grid cols_1 laptops-cols_inherit tablets-cols_inherit mobiles-cols_1 valign_top type_default stacking_default\"><div class=\"wpb_column vc_column_container\"><div class=\"vc_column-inner\"><div class=\"wpb_text_column\"><div class=\"wpb_wrapper\"><h3><span class=\"ez-toc-section\" id=\"Introduction\"><\/span>Introduction<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p><span style=\"font-weight: 400;\">The Configuration Workbench handles all the key aspects of the index configuration needed in transforming the available content into objects for <\/span><span style=\"font-weight: 400;\">effective<\/span><span style=\"font-weight: 400;\"> indexing.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">An Indexing Pipeline is a series of indexing stages that prepares the content into a document compatible and ready for indexing. Each stage performs a specific set of transformations on the data before passing it onto the next stage in the pipeline.Each stage has a stage-specific configuration. Rearrange or sequence the stages in the order of your preferred flow <\/span><span style=\"font-weight: 400;\">by a simple drag and drop action<\/span><span style=\"font-weight: 400;\">.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For example, extract the <\/span><span style=\"font-weight: 400;\">entity values<\/span><span style=\"font-weight: 400;\"> before processing trait properties or vice versa. SearchAssist allows you to develop a custom pipeline per each configuration in the Index Workbench to suit your business requirements.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">An indexing stage has properties like stage type, stage name, and applicable conditions. <\/span><span style=\"font-weight: 400;\">Define the conditions to choose the documents that must be transformed. For example, you can write a condition to consider only the FAQs.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For best results click <\/span><b>Train your App<\/b><span style=\"font-weight: 400;\"> each time you make changes to any indexing configuration. This ensures the indexing based on the latest or updated configurations.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In case you want to test the Search Assistant for select stages <\/span><span style=\"font-weight: 400;\">only<\/span><span style=\"font-weight: 400;\"> and not all, choose to render the other stages <\/span><b>inactive <\/b><span style=\"font-weight: 400;\">with the toggle switch on the upper-right corner. This will retain those stages but at the same time, they won\u2019t be considered in the indexing configuration. You can activate those inactivated stages at a later time as required.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Indexing\u00a0 pipeline stages are listed here:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">The <\/span><b>Field Mapping<\/b><span style=\"font-weight: 400;\"> stage is used to map fields in an indexing pipeline document to a target field, set values, copy values, remove fields, and much more. Refer <\/span><a href=\"https:\/\/multisite.korebots.com\/SearchAssist\/concepts\/managing-indices\/configuring-workbench\/configure-workbench\/#Mapping_Fields_in_the_Workbench\"><span style=\"font-weight: 400;\">Mapping Fields in the Workbench<\/span><\/a><\/li>\n<li style=\"font-weight: 400;\"><b>Keyword Extraction <\/b><span style=\"font-weight: 400;\">is a technique to automatically detect important words from the text stored in a field. Refer <\/span><a href=\"https:\/\/multisite.korebots.com\/SearchAssist\/concepts\/managing-indices\/configuring-workbench\/configure-workbench\/#Extracting_Keywords\"><span style=\"font-weight: 400;\">Extracting Keywords<\/span><\/a><\/li>\n<li style=\"font-weight: 400;\"><b>Traits Extraction <\/b><span style=\"font-weight: 400;\">extracts specific attributes, or characteristics\u00a0 that the search users might express in their conversations. Refer <\/span><a href=\"https:\/\/multisite.korebots.com\/SearchAssist\/concepts\/managing-indices\/configuring-workbench\/configure-workbench\/#Extracting_Traits\"><span style=\"font-weight: 400;\">Extracting Traits<\/span><\/a><\/li>\n<li style=\"font-weight: 400;\"><b>Entity Extraction <\/b><span style=\"font-weight: 400;\">uses NLP techniques to identify named entities from the source field. Refer <\/span><a href=\"https:\/\/multisite.korebots.com\/SearchAssist\/concepts\/managing-indices\/configuring-workbench\/configure-workbench\/#Extracting_Entities\"><span style=\"font-weight: 400;\">Extracting Entities<\/span><\/a><\/li>\n<li style=\"font-weight: 400;\"><b>Semantic Meaning<\/b><span style=\"font-weight: 400;\"> analysis is the technique to understand the meaning and interpretation of words, signs, and sentence structure.\u00a0 Refer <\/span><a href=\"https:\/\/multisite.korebots.com\/SearchAssist\/concepts\/managing-indices\/configuring-workbench\/configure-workbench\/#Applying_Semantic_Meanings\"><span style=\"font-weight: 400;\">Applying Semantic Meanings<\/span><\/a><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">Note: The feature of \u201cApplying Semantic Meanings\u201d currently supports\u00a0 only the Web page related sources.\u00a0<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><b>Custom Script<\/b><span style=\"font-weight: 400;\"> stage allows you to enter customized scripts to perform any field mapping tasks like deleting or renaming fields. Refer <\/span><a href=\"https:\/\/multisite.korebots.com\/SearchAssist\/concepts\/managing-indices\/configuring-workbench\/configure-workbench\/#Running_Custom_Scripts\"><span style=\"font-weight: 400;\">Running Custom Scripts<\/span><\/a><\/li>\n<\/ul>\n<p><b>Exclude Document<\/b><span style=\"font-weight: 400;\"> stage drops all the documents that match the specified condition. Refer <\/span><a href=\"https:\/\/multisite.korebots.com\/SearchAssist\/concepts\/managing-indices\/configuring-workbench\/configure-workbench\/#Excluding_Documents_from_Scope\"><span style=\"font-weight: 400;\">Excluding Documents from Scope<\/span><\/a><\/p>\n<h3 class=\"w-post-elm post_title entry-title\"><span class=\"ez-toc-section\" id=\"Mapping_Fields_in_the_Workbench\"><\/span><span id=\"Mapping_Fields_in_the_Workbench\" class=\"ez-toc-section\">Mapping Fields in the Workbench<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"w-post-elm post_content\">\n<p>The Field Mapping stage in\u00a0Indexing Pipeline\u00a0 is used to map fields in an index pipeline document to a target field.<\/p>\n<p>SearchAssist allows you to:<\/p>\n<ul>\n<li><b>Set\u00a0<\/b>a field value,\u00a0<b>Rename\u00a0<\/b>a field,\u00a0<b>Copy\u00a0<\/b>one field to another, or\u00a0<b>Remove\u00a0<\/b>a field<\/li>\n<li>Define a condition for the field mapping stage. The field mapping actions occur on the documents that satisfy the given condition<\/li>\n<li>Re-order or delete a\u00a0<b>Field Mapping<\/b><\/li>\n<li>Simulate to test the changes before saving them<\/li>\n<\/ul>\n<p>Ensure to click\u00a0<b>Train your App\u00a0<\/b>each time you make changes to any index configuration.\u00a0This builds the index based on the updated configurations.<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-e1645526249397.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-3491 size-full aligncenter\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-e1645526249397.png\" alt=\"\" width=\"460\" height=\"59\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-e1645526249397.png 460w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-e1645526249397-300x38.png 300w\" sizes=\"(max-width: 460px) 100vw, 460px\" \/><\/a><\/p>\n<p>To configure field mapping, take the following steps:<\/p>\n<ol>\n<li>Click the\u00a0<b>Indices\u00a0<\/b>tab on the top.<\/li>\n<li>On the left pane, under the\u00a0<b>Index Configuration<\/b>\u00a0section, click\u00a0<b>Workbench<\/b>.<\/li>\n<li>On the Workbench page, on the\u00a0<b>Stages\u00a0<\/b>column, click the\u00a0<strong>+<\/strong>\u00a0icon.<\/li>\n<li>Select\u00a0<b>Field Mapping<\/b>\u00a0from the\u00a0<b>Stage Type<\/b>\u00a0dropdown.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_simulate-field-mapping-stage-type.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3492 size-medium\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_simulate-field-mapping-stage-type-300x251.png\" alt=\"\" width=\"300\" height=\"251\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_simulate-field-mapping-stage-type-300x251.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_simulate-field-mapping-stage-type.png 520w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/li>\n<li>Enter a name in the\u00a0<b>Stage Name<\/b>\u00a0field.<br \/>\n<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_simulate-field-mapping.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3493 size-large\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_simulate-field-mapping-1024x314.png\" alt=\"\" width=\"640\" height=\"196\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_simulate-field-mapping-1024x314.png 1024w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_simulate-field-mapping-300x92.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_simulate-field-mapping.png 1651w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><\/li>\n<li>Enter a condition in the\u00a0<b>Condition\u00a0<\/b>field. Add multiple conditions using AND\/OR connectors. SearchAssist considers the documents that satisfy the conditions as part of the stage.<\/li>\n<li>Select an action from the\u00a0<b>Action\u00a0<\/b>dropdown. See the following\u00a0details.<\/li>\n<li>Click\u00a0<b>Simulate<\/b>\u00a0to verify the configurations. The simulator displays the Source and the number of documents to which the mapping was applied, and the result. You can change the Source and the number of documents if there is no mention in the conditions.<\/li>\n<li>Once done, click\u00a0<b>Save Configuration<\/b>\u00a0on the top-right. For example, select\u00a0<b>Set\u00a0<\/b>from the\u00a0<b>Actions\u00a0<\/b>dropdown list; enter\u00a0<i>Title\u00a0<\/i>in the<b>\u00a0Field Name<\/b>\u00a0field and enter\u00a0<i>Heading\u00a0<\/i>in the\u00a0<b>Value\u00a0<\/b>field. Click\u00a0<b>Simulate\u00a0<\/b>to verify if the field value is changed. Perform associated\u00a0<strong>Actions<\/strong>\u00a0to:\n<ul>\n<li><b>Set<\/b>\u00a0a\u00a0<i>Value\u00a0<\/i>for the\u00a0<i>Field Name<\/i><\/li>\n<li><b>Rename<\/b>\u00a0to a\u00a0<i>New Name<\/i>\u00a0for the<i> Field Name<\/i><\/li>\n<li><b>Copy<\/b>\u00a0the\u00a0<i>Source Field<\/i>\u00a0to the\u00a0<i>Target Field<\/i><\/li>\n<li><b>Remove<\/b>\u00a0 the\u00a0<i>Field Name<\/i><\/li>\n<\/ul>\n<\/li>\n<li>Use the handlebar to reorder the action sequence as required.\n<p><a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_Simulate_fields-handlebar-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3664 size-large\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_Simulate_fields-handlebar-1-1024x197.png\" alt=\"\" width=\"640\" height=\"123\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_Simulate_fields-handlebar-1-1024x197.png 1024w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_Simulate_fields-handlebar-1-300x58.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_Simulate_fields-handlebar-1.png 1396w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><\/li>\n<\/ol>\n<h4>Conditions for Mapping Fields<\/h4>\n<p>Condition is of the following format:\u00a0ctx.fieldtype==value\u00a0or\u00a0ctx.fieldtype!=value.<\/p>\n<p>For example,\u00a0ctx.contentType==\u201dweb\u201d\u00a0to restrict the mapping to content from a web source<\/p>\n<\/div>\n<h3 class=\"w-post-elm post_title entry-title\"><span class=\"ez-toc-section\" id=\"Extracting_Keywords\"><\/span><span id=\"Extracting_Keywords\" class=\"ez-toc-section\">Extracting Keywords<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"w-post-elm post_content\">\n<p>Keyword Extraction is a technique to automatically detect important\u00a0 and relevant words from the text stored in a field.<\/p>\n<p>The Keyword Extraction stage in\u00a0Indexing Pipeline\u00a0\u00a0to identify a set of keywords from a source field and save the identified keywords in a target field. Use the target field\u00a0 to identify the intention of the search user better.<\/p>\n<p>SearchAssist applies various NLP algorithms to extract keywords.<\/p>\n<p>SearchAssist allows you to:<\/p>\n<ul>\n<li>Define a condition for the keyword extraction stage. SearchAssist extract keywords only from the documents that satisfy the given condition<\/li>\n<li>Re-order or delete keyword extractions<\/li>\n<li><b>Simulate\u00a0<\/b>the changes before saving them<\/li>\n<\/ul>\n<p>Ensure to click\u00a0\u00a0<b>Train your App<\/b>\u00a0each time you make changes to any index configuration. This builds the index based on the updated configurations.<br \/>\n<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-3.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3503 size-full\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-3.png\" alt=\"\" width=\"460\" height=\"59\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-3.png 460w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-3-300x38.png 300w\" sizes=\"(max-width: 460px) 100vw, 460px\" \/><\/a><br \/>\nTo configure for keyword extraction, take the following steps:<\/p>\n<ol>\n<li>Click the\u00a0<b>Indices\u00a0<\/b>tab on the top<\/li>\n<li>On the left pane, under the\u00a0<b>Index Configuration<\/b>\u00a0section, click\u00a0<b>Workbench<\/b><\/li>\n<li>On the Workbench (Index Configuration) page, on the\u00a0<b>Stages\u00a0<\/b>column, click the\u00a0<strong>+<\/strong> icon<\/li>\n<li>Select\u00a0<b>Keyword Extraction<\/b>\u00a0from the\u00a0<b>Stage Type<\/b> dropdown<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_keyword-extraction-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3498 size-medium\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_keyword-extraction-1-300x267.png\" alt=\"\" width=\"300\" height=\"267\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_keyword-extraction-1-300x267.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_keyword-extraction-1.png 487w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/li>\n<li>Enter a name in the\u00a0<b>Stage Name<\/b>\u00a0field.<\/li>\n<li>Enter a condition in the\u00a0<b>Condition\u00a0<\/b>field.\u00a0 You can add multiple conditions using the AND\/OR connectors. SearchAssist considers only the documents that satisfy the conditions part of the stage. Refer the following\u00a0 &#8220;Conditions for Keyword Extraction&#8221;.<\/li>\n<li>Select the field you want to extract keyword from as\u00a0<b>Source Field<\/b><\/li>\n<li>Name the\u00a0<strong>Target Field<\/strong>\u00a0 where you want to store the extracted keywords. The Search Assistant creates this field.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_keyword-extraction2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3499 size-large\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_keyword-extraction2-1024x270.png\" alt=\"\" width=\"640\" height=\"169\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_keyword-extraction2-1024x270.png 1024w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_keyword-extraction2-300x79.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_keyword-extraction2.png 1662w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><br \/>\nThe following models are supported:<\/p>\n<ul>\n<li><b>Topic Rank<\/b> \u2013 it\u2019s a method to extract keyphrases from the most important topics of a document<\/li>\n<li><b>Position Rank<\/b> \u2013 it\u2019s a method to capture both highly frequent words or phrases and their position in a document<\/li>\n<li><b>Multi-partite Rank<\/b> \u2013 it\u2019s a keyphrase extraction method that encodes topical information within a multi-partite graph structure<\/li>\n<\/ul>\n<\/li>\n<li>Click\u00a0<b>Simulate<\/b>\u00a0to verify the configurations. The simulator displays the Source and the number of documents to which the mapping was applied, and the result. You can change the Source and the number of documents if there is no mention in the conditions.<\/li>\n<li>Once ready, click\u00a0<b>Save Configuration<\/b>\u00a0on the upper-right.<\/li>\n<\/ol>\n<p>Conditions for Keyword ExtractionCondition is of the following format:\u00a0ctx.field_name==value\u00a0or\u00a0ctx.field_name!=value.<\/p>\n<p>Obtain the\u00a0<i>field_name<\/i>\u00a0from the Fields table under Index Configuration.<\/p>\n<p>For example,\u00a0ctx.contentType==\u201dweb\u201d\u00a0to restrict the extraction from the content from a web source.<\/p>\n<\/div>\n<h3 class=\"w-post-elm post_title entry-title\"><span class=\"ez-toc-section\" id=\"Extracting_Traits\"><\/span><span id=\"Extracting_Traits\" class=\"ez-toc-section\">Extracting Traits<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"w-post-elm post_content\">\n<section class=\"l-section wpb_row height_auto width_full\">\n<div class=\"l-section-h i-cf\">\n<div class=\"g-cols vc_row type_default valign_top\">\n<div class=\"vc_col-sm-12 wpb_column vc_column_container\">\n<div class=\"vc_column-inner\">\n<div class=\"wpb_wrapper\">\n<div class=\"wpb_text_column \">\n<div class=\"wpb_wrapper\">\n<p>The Traits Extraction stage in\u00a0Indexing Pipeline\u00a0\u00a0extracts specific or characteristic\u00a0 attributes, or details that the search users express in their conversations. SearchAssist allows you to identify trait characteristics from a source field and save the identified traits in a target field.\u00a0The target field is used to detect user intentions better.<\/p>\n<p>SearchAssist allows you to:<\/p>\n<ul>\n<li>Add multiple trait groups to be identified from the source field<\/li>\n<li>Define a condition for the trait extraction stage. SearchAssist extract traits only from the documents that satisfy the given conditions<\/li>\n<li>Re-order or delete trait extractions<\/li>\n<li>Simulate the changes before saving them<\/li>\n<\/ul>\n<p>Ensure to click\u00a0\u00a0<b>Train your App<\/b>\u00a0each time you make changes to any index configuration. This builds the index based on the updated configurations.<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3500 size-full\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-2.png\" alt=\"\" width=\"460\" height=\"59\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-2.png 460w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-2-300x38.png 300w\" sizes=\"(max-width: 460px) 100vw, 460px\" \/><\/a><br \/>\nConfiguration: to configure for traits extraction, take the following steps:<\/p>\n<ol>\n<li>Click the\u00a0<b>Indices\u00a0<\/b>tab on the top.<\/li>\n<li>On the left pane, under the\u00a0<b>Index Configuration<\/b>\u00a0section, click\u00a0<b>Workbench<\/b>.<\/li>\n<li>On the Workbench (Index Configuration) page, on the\u00a0<b>Stages\u00a0<\/b>column, click the\u00a0<strong>+<\/strong>\u00a0icon.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_traits3.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3501 size-medium\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_traits3-300x220.png\" alt=\"\" width=\"300\" height=\"220\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_traits3-300x220.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_traits3.png 558w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/li>\n<li>Select\u00a0<b>Traits Extraction<\/b>\u00a0from the\u00a0<b>Stage Type<\/b>\u00a0dropdown.<\/li>\n<li>Enter a name in the\u00a0<b>Stage Name<\/b>\u00a0field.<\/li>\n<li>Enter a condition in the\u00a0<b>Condition\u00a0<\/b>field. Add multiple conditions using the AND\/OR connectors. SearchAssists considers only the documents that satisfy the conditions as part of the stage. See\u00a0<a href=\"https:\/\/docs.google.com\/document\/d\/1A1G6RzvrbxqNQtagGPWiBYSm2sIZaKiB\/edit#bookmark=id.rnglm3s1ipvo\">Conditions in\u00a0 Extraction<\/a>.<\/li>\n<li>Select the field you want to extract traits from as\u00a0<b>Source<\/b>\u00a0<b>Field<\/b>.<\/li>\n<li>Name the\u00a0<strong>Target Field<\/strong>\u00a0 where you want to store the extracted traits. The Search Assistant creates the target field.<\/li>\n<li>Enter trait groups in the\u00a0<b>Add Trait Groups<\/b>\u00a0field.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_traits2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3502 size-large\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_traits2-1024x488.png\" alt=\"\" width=\"640\" height=\"305\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_traits2-1024x488.png 1024w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_traits2-300x143.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_traits2.png 1651w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><\/li>\n<li>Click\u00a0<b>Simulate<\/b>\u00a0to verify the configurations. The simulator displays the Source and the number of documents to which the mapping was applied, and the result. You can change the Source and the number of documents if there is no mention of it in the conditions.<\/li>\n<li>Once ready, click\u00a0<strong>Save Configuration<\/strong>\u00a0on the upper-right.<\/li>\n<\/ol>\n<h4>Conditions in\u00a0 Extracting Traits<\/h4>\n<p>Condition is of the following format:\u00a0ctx.fieldtype==value\u00a0or\u00a0ctx.fieldtype!=value. Obtain the\u00a0<i>field_name<\/i>\u00a0from the Fields table under Index Configuration.<\/p>\n<p>For example,\u00a0ctx.contentType==\u201dweb\u201d\u00a0to restrict the extraction to the content from a web source.<\/p>\n<\/div>\n<h3 class=\"w-post-elm post_title entry-title\"><span class=\"ez-toc-section\" id=\"Extracting_Entities\"><\/span><span id=\"Extracting_Entities\" class=\"ez-toc-section\">Extracting Entities<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"w-post-elm post_content\">\n<section class=\"l-section wpb_row height_auto width_full\">\n<div class=\"l-section-h i-cf\">\n<div class=\"g-cols vc_row type_default valign_top\">\n<div class=\"vc_col-sm-12 wpb_column vc_column_container\">\n<div class=\"vc_column-inner\">\n<div class=\"wpb_wrapper\">\n<div class=\"wpb_text_column \">\n<div class=\"wpb_wrapper\">\n<p>Entity Extraction refers to the required information expected from the user as input to accomplish the task. Search Assistant uses NLP techniques to find named entities from the source field.<\/p>\n<p>The Entity Extraction stage in\u00a0Indexing Pipeline\u00a0is used to identify a set of entities from a source field and save the identified entities in a target field. SearchAssist uses the target field to identify the intention of the search user more accurately.<\/p>\n<p>SearchAssist allows you to:<\/p>\n<ul>\n<li>Add multiple entities to be extracted from the source field<\/li>\n<li>Define a condition for the entity extraction stage and the entities are extracted only from the documents that satisfy the given condition<\/li>\n<li>Re-order or delete entity extraction rules<\/li>\n<li>Simulate the changes before saving them<\/li>\n<\/ul>\n<p>Ensure to click\u00a0<b>Train your App<\/b>\u00a0each time you make changes to any index configuration. This builds the index based on the updated configurations.<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-3.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3503 size-full\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-3.png\" alt=\"\" width=\"460\" height=\"59\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-3.png 460w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Train_your_App_icon-3-300x38.png 300w\" sizes=\"(max-width: 460px) 100vw, 460px\" \/><\/a><\/p>\n<p>Configuration: to configure for entity extraction, take the following steps:<\/p>\n<ol>\n<li>Click the\u00a0<b>Indices\u00a0<\/b>tab on the top.<\/li>\n<li>On the left pane, under the\u00a0<b>Index Configuration<\/b>\u00a0section, click\u00a0<b>Workbench<\/b>.<\/li>\n<li>On the Workbench (Index Configuration) page, on the\u00a0<b>Stages\u00a0<\/b>column, click the\u00a0<b>+<\/b>\u00a0icon.<\/li>\n<li>Select\u00a0<b>Entity Extraction<\/b>\u00a0from the\u00a0<b>Stage Type<\/b>\u00a0dropdown.<img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3504\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_entity-extraction-300x233.png\" alt=\"\" width=\"312\" height=\"242\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_entity-extraction-300x233.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2022\/01\/Manage_indices_wb_entity-extraction.png 530w\" sizes=\"(max-width: 312px) 100vw, 312px\" \/><a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_entity-extraction.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-1633 size-medium\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_entity-extraction-300x242.png\" sizes=\"(max-width: 300px) 100vw, 300px\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_entity-extraction-300x242.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_entity-extraction.png 540w\" alt=\"\" width=\"300\" height=\"242\" data-pagespeed-url-hash=\"1550460172\" \/><\/a><\/li>\n<li>Enter a name in the\u00a0<b>Stage Name<\/b>\u00a0field.<\/li>\n<li>Enter a condition in the\u00a0<b>Condition\u00a0<\/b>field. You can add multiple conditions using the AND\/OR connectors\/extensions. SearchAssists considers only the documents that satisfy the conditions as part of the stage.\u00a0<a href=\"https:\/\/docs.google.com\/document\/d\/1A1G6RzvrbxqNQtagGPWiBYSm2sIZaKiB\/edit#bookmark=id.vcjez21cubt7\">See the following details<\/a>.<\/li>\n<li>Select the field you want to extract the entity from as\u00a0<b>Source Field<\/b>.<\/li>\n<li>Name the\u00a0<strong>Target Field<\/strong>\u00a0 where you want to store the extracted entity. The Search Assistant creates\u00a0 the target field.<\/li>\n<li>Select an entity from the\u00a0<b>Add Entities<\/b>\u00a0field. These are the entity types that need to be identified from the source field. The supported entities are Date, Time, Date-Time, Date Period, URL, Email, Location, City, Country, Color, Company Name, Currency, Person Name, Number, Percentage, Phone Number, Zip Code, Quantity, Address, and Airport.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_entity-extraction2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-1634 size-large\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_entity-extraction2-1024x487.png\" sizes=\"(max-width: 640px) 100vw, 640px\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_entity-extraction2-1024x487.png 1024w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_entity-extraction2-300x143.png 300w\" alt=\"\" width=\"640\" height=\"304\" data-pagespeed-url-hash=\"3475274597\" \/><\/a><\/li>\n<li>Click\u00a0<b>Simulate<\/b>\u00a0to verify the configurations. The simulator displays the Source and the number of documents to which the mapping was applied, and the result. You can change the Source and the number of documents if there is no mention of it in the conditions.<\/li>\n<li>Once ready, click\u00a0<b>Save Configuration<\/b>\u00a0on the upper-right.<\/li>\n<\/ol>\n<h4>Conditions to Extract Entities<\/h4>\n<p>Condition is of the following format:\u00a0ctx.fieldtype==value\u00a0or\u00a0ctx.fieldtype!=value. Obtain the\u00a0<i>field_name<\/i>\u00a0from the Fields table under Index Configuration.<\/p>\n<p>For example,\u00a0ctx.contentType==\u201dweb\u201d\u00a0to restrict the extraction to the content from a web source.<\/p>\n<h3 class=\"w-post-elm post_title entry-title\"><span class=\"ez-toc-section\" id=\"Applying_Semantic_Meanings\"><\/span><span id=\"Applying_Semantic_Meanings\" class=\"ez-toc-section\">Applying Semantic Meanings<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"w-post-elm post_content\">\n<section class=\"l-section wpb_row height_auto width_full\">\n<div class=\"l-section-h i-cf\">\n<div class=\"g-cols vc_row type_default valign_top\">\n<div class=\"vc_col-sm-12 wpb_column vc_column_container\">\n<div class=\"vc_column-inner\">\n<div class=\"wpb_wrapper\">\n<div class=\"wpb_text_column \">\n<div class=\"wpb_wrapper\">\n<p>Semantic analysis is the technique to understand the meaning and interpretation of words, signs, and sentence structure.<\/p>\n<p>SearchAssist\u2019s\u00a0Indexing Pipeline\u00a0supports a Semantic Meaning stage. This stage uses\u00a0<i>Deep Neural Network<\/i>\u00a0algorithms to create inserts of free text and saves them in a dense vector field. SearchAssist uses these embeddings to rank the documents by semantic relevance.\u00a0The dense vectors are then indexed in the search\u00a0 and similarity is obtained between the user\u2019s query vector and the indexed content vector.<\/p>\n<p><span style=\"font-weight: 400;\">Currently you can apply semantic meanings only on content from websites. When SearchAssist semantically interprets the source from a natural language\u00a0 perspective, the relevant results get priority over others.<\/span><\/p>\n<p>SearchAssist allows you to:<\/p>\n<ul>\n<li>Add multiple semantics to be analyzed from the source field<\/li>\n<li>Define a condition for the semantic meaning stage. The semantics from only the documents that satisfy the given condition would be analyzed<\/li>\n<li>Re-order or delete semantic meaning rules<\/li>\n<li>Simulate the changes before saving them<\/li>\n<\/ul>\n<p>Ensure to click\u00a0<b>Train your App<\/b>\u00a0each time you make changes to any index configuration. This builds the index based on the updated configurations.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Train_your_App_icon.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-1605 size-full\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Train_your_App_icon.png\" sizes=\"(max-width: 460px) 100vw, 460px\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Train_your_App_icon.png 460w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Train_your_App_icon-300x38.png 300w\" alt=\"\" width=\"460\" height=\"59\" data-pagespeed-url-hash=\"2049583651\" \/><\/a><\/p>\n<p>Configuration:\u00a0to configure for applying semantic meaning, take the following steps:<\/p>\n<ol>\n<li>Click the\u00a0<b>Indices\u00a0<\/b>tab on the top.<\/li>\n<li>On the left pane, under the\u00a0<b>Index Configuration<\/b>\u00a0section, click\u00a0<b>Workbench<\/b>.<\/li>\n<li>On the Workbench (Index Configuration) page, on the\u00a0<b>Stages\u00a0<\/b>column, click the\u00a0<b>+<\/b>\u00a0icon.<\/li>\n<li>Select\u00a0<b>Semantic Meaning<\/b>\u00a0from the\u00a0<b>Stage Type<\/b>\u00a0dropdown list.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_semantic-meaning1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-1644 size-medium\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_semantic-meaning1-300x274.png\" sizes=\"(max-width: 300px) 100vw, 300px\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_semantic-meaning1-300x274.png 300w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_semantic-meaning1.png 490w\" alt=\"\" width=\"300\" height=\"274\" data-pagespeed-url-hash=\"3061569729\" \/><\/a><\/li>\n<li>Enter a name in the\u00a0<b>Stage Name<\/b>\u00a0field.<\/li>\n<li>Enter a condition in the\u00a0<b>Condition\u00a0<\/b>field. You can add multiple conditions using the AND\/OR connectors. SearchAssists considers only the documents that satisfy the conditions as part of the stage. Refer the following &#8220;Conditions for Applying Semantic Meanings&#8221;.<\/li>\n<li>Select the field you want to extract Semantic Meaning from as\u00a0<b>Source Field<\/b>.<\/li>\n<li>Define where you want to store the extracted Semantic Meaning as\u00a0<b>Target Field<\/b>. The Search Assistant creates this Target Field.<\/li>\n<li>Choose a model from the\u00a0<b>Choose Model<\/b>\u00a0dropdown list. <a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_semantic-meaning2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-1645 size-large\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_semantic-meaning2-1024x490.png\" sizes=\"(max-width: 640px) 100vw, 640px\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_semantic-meaning2-1024x490.png 1024w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_semantic-meaning2-300x143.png 300w\" alt=\"\" width=\"640\" height=\"306\" data-pagespeed-url-hash=\"3265663890\" \/><\/a><\/li>\n<li>Click\u00a0<b>Simulate<\/b> to verify the configurations. The simulator displays the Source and the number of documents to which the mapping was applied, and the result. You can change the Source if there is no mention in the condition and the number of documents.<\/li>\n<li>Once ready, click\u00a0<b>Save Configuration<\/b>\u00a0on the upper-right.<\/li>\n<\/ol>\n<p>Supported Models in Semantic Analysis: the following models are supported<\/p>\n<ul>\n<li><b>Universal Sentence Encoder<\/b> \u2013 It encodes text into high-dimensional vectors that are used for semantic similarity<\/li>\n<li><b>Sentence Transformers<\/b> \u2013 it\u2019s a framework for sentence and text embeddings<\/li>\n<li><b>InferSent<\/b> \u2013 it\u2019s a sentence embedding method that provides semantic sentence representations<\/li>\n<\/ul>\n<h4>Conditions for Semantic Analysis<\/h4>\n<p>Condition is of the following format:\u00a0ctx.fieldtype==value\u00a0or\u00a0ctx.fieldtype!=value. The\u00a0<i>field_name<\/i>\u00a0can be obtained from the Fields table under Index Configuration.<\/p>\n<p>For example,\u00a0ctx.contentType==\u201dweb\u201d\u00a0to restrict the extraction to the content from a web source.<\/p>\n<h3 class=\"w-post-elm post_title entry-title\"><span class=\"ez-toc-section\" id=\"Running_Custom_Scripts\"><\/span><span id=\"Running_Custom_Scripts\" class=\"ez-toc-section\">Running Custom Scripts<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"w-post-elm post_content\">\n<section class=\"l-section wpb_row height_auto width_full\">\n<div class=\"l-section-h i-cf\">\n<div class=\"g-cols vc_row type_default valign_top\">\n<div class=\"vc_col-sm-12 wpb_column vc_column_container\">\n<div class=\"vc_column-inner\">\n<div class=\"wpb_wrapper\">\n<div class=\"wpb_text_column \">\n<div class=\"wpb_wrapper\">\n<p>The Custom Script stage in\u00a0Indexing Pipeline\u00a0allows code custom processing. You can write a painless script to perform actions such as adding a new field, deleting a field, setting\/resetting values to a field, copying fields, etc.<\/p>\n<p>Ensure to click\u00a0\u00a0<b>Train your App<\/b> each time you make changes to any index configuration. This builds the index based on the updated configurations.<\/p>\n<p>Configuration:\u00a0to configure a custom script, take the following steps:<\/p>\n<ol>\n<li>Click the\u00a0<b>Indices\u00a0<\/b>tab on the top.<\/li>\n<li>On the left pane, under the\u00a0<b>Index Configuration<\/b>\u00a0section, click\u00a0<b>Workbench<\/b>.<\/li>\n<li>On the Workbench (Index Configuration) page, on the\u00a0<b>Stages\u00a0<\/b>column, click the\u00a0<strong>+<\/strong>\u00a0icon.<\/li>\n<li>Select\u00a0<b>Custom Script<\/b>\u00a0from the\u00a0<b>Stage Type<\/b>\u00a0dropdown list.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_custom-script1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-1648 size-medium\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_custom-script1-293x300.png\" sizes=\"(max-width: 293px) 100vw, 293px\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_custom-script1-293x300.png 293w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_custom-script1.png 476w\" alt=\"\" width=\"293\" height=\"300\" data-pagespeed-url-hash=\"2000155285\" \/><\/a><\/li>\n<li>Enter a name in the\u00a0<b>Stage Name<\/b>\u00a0field.<\/li>\n<li>Enter a condition in the\u00a0<b>Condition\u00a0<\/b>field.\u00a0 Add multiple conditions using the AND\/OR connectors. SearchAssist execudes documents that satisfy the condition(s). Refer the following &#8220;Conditions for Running Scripts&#8221;.<\/li>\n<li>Under the\u00a0<b>&lt;\/&gt;Painless<\/b>\u00a0section, enter the custom script. See the following\u00a0details.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_custom-script2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-1650 size-large\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_custom-script2-1024x489.png\" sizes=\"(max-width: 640px) 100vw, 640px\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_custom-script2-1024x489.png 1024w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_custom-script2-300x143.png 300w\" alt=\"\" width=\"640\" height=\"306\" data-pagespeed-url-hash=\"4072114053\" \/><\/a><\/li>\n<li>Click\u00a0<b>Simulate<\/b>\u00a0to verify the configurations. The simulator displays the Source and the number of documents to which the mapping was applied, and the result. You can change the Source and the number of documents if there is no mention of it in the conditions.<\/li>\n<li>Once ready, click\u00a0<b>Save Configuration<\/b>\u00a0on the upper-right.<\/li>\n<\/ol>\n<p>Script Example:\u00a0to copy a value from <i>\u201cdefaultAnswers[*].payload\u201d<\/i>\u00a0to<i>\u00a0\u201canswer[]\u201d<\/i>, use the following script:<\/p>\n<p>ctx.answer =[]; for (def item : ctx.defaultAnswers) { ctx.answer.add(item.payload) }<\/p>\n<h4>Conditions for Running Scripts<\/h4>\n<p>Condition is of the following format:\u00a0ctx.fieldtype==value\u00a0or\u00a0ctx.fieldtype!=value. The\u00a0<i>field_name<\/i>\u00a0can be obtained from the Fields table under Index Configuration.<\/p>\n<p>For example,\u00a0ctx.contentType==\u201dweb\u201d\u00a0to restrict the extraction to the content from a web source.<\/p>\n<h3 class=\"w-post-elm post_title entry-title\"><span class=\"ez-toc-section\" id=\"Excluding_Documents_from_Scope\"><\/span><span id=\"Excluding_Documents_from_Scope\" class=\"ez-toc-section\">Excluding Documents from Scope<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"w-post-elm post_content\">\n<section class=\"l-section wpb_row height_auto width_full\">\n<div class=\"l-section-h i-cf\">\n<div class=\"g-cols vc_row type_default valign_top\">\n<div class=\"vc_col-sm-12 wpb_column vc_column_container\">\n<div class=\"vc_column-inner\">\n<div class=\"wpb_wrapper\">\n<div class=\"wpb_text_column \">\n<div class=\"wpb_wrapper\">\n<p>The Exclude Document stage in\u00a0Indexing Pipeline\u00a0allows you to drop all the documents that match the specified conditions. SearchAssist ignores documents in the subsequent stages of the indexing pipeline and leaves them without indexing.<\/p>\n<p>Ensure\u00a0 to click\u00a0<b>Train your App<\/b>\u00a0each time you make changes to any index configuration. This builds the index based on the updated configurations.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Train_your_App_icon.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-1605 size-full\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Train_your_App_icon.png\" sizes=\"(max-width: 460px) 100vw, 460px\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Train_your_App_icon.png 460w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Train_your_App_icon-300x38.png 300w\" alt=\"\" width=\"460\" height=\"59\" data-pagespeed-url-hash=\"2049583651\" \/><\/a><\/p>\n<p>To configure a exclude document stage, take the following steps:<\/p>\n<ol>\n<li>Click the\u00a0<b>Indices\u00a0<\/b>tab on the top.<\/li>\n<li>On the left pane, under the\u00a0<b>Index Configuration<\/b>\u00a0section, click\u00a0<b>Workbench<\/b>.<\/li>\n<li>On the Workbench (Index Configuration) page, on the\u00a0<b>Stages\u00a0<\/b>column, click the\u00a0<b>+<\/b>\u00a0icon.<\/li>\n<li>Select\u00a0<b>Exclude Document<\/b>\u00a0from the\u00a0<b>Stage Type<\/b>\u00a0dropdown list.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_exclude-documents1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-1654 size-medium\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_exclude-documents1-e1645527178551-300x266.png\" alt=\"\" width=\"300\" height=\"266\" data-pagespeed-url-hash=\"1175694781\" \/><\/a><\/li>\n<li>Enter a name in the\u00a0<b>Stage Name<\/b>\u00a0field.<\/li>\n<li>Enter a condition in the\u00a0<b>Condition\u00a0<\/b>field. Add multiple conditions using the AND\/OR connectors. SearchAssist excludes the documents that contain the field mentioned in the conditions as part of the stage. See the following &#8220;Conditions for Excluding Docs&#8221;.<br \/>\nNOTE: It\u2019s mandatory to add conditions for defining the Exclude Document stage.<a ref=\"magnificPopup\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_exclude-documents2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-1656 size-large aligncenter\" src=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_exclude-documents2-1024x489.png\" sizes=\"(max-width: 640px) 100vw, 640px\" srcset=\"https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_exclude-documents2-1024x489.png 1024w, https:\/\/multisite.korebots.com\/SearchAssist\/wp-content\/uploads\/sites\/18\/2021\/12\/Manage_indices_wb_exclude-documents2-300x143.png 300w\" alt=\"\" width=\"640\" height=\"306\" data-pagespeed-url-hash=\"2641965791\" \/><\/a><\/li>\n<li>Click\u00a0<b>Simulate<\/b>\u00a0to verify the configurations. The simulator displays the Source and the number of documents to which the mapping was applied, and the result. You can change the Source and the number of documents if there is no mention of it in the conditions.<\/li>\n<li>Once ready, click\u00a0<b>Save Configuration<\/b>\u00a0on the upper-right.<\/li>\n<\/ol>\n<p>Conditions for Excluding Docs:<\/p>\n<p>Condition is of the following format:\u00a0ctx.fieldtype==value\u00a0or\u00a0ctx.fieldtype!=value. i.e.,\u00a0\u00a0the condition can be a certain field type equals a certain value or not equal to a certain value.<\/p>\n<p>value here being file types: FAQs, web<\/p>\n<p>The\u00a0<i>field_name<\/i>\u00a0can be obtained from the Fields table under Index Configuration.<br \/>\nFor example,\u00a0ctx.contentType==\u201dweb\u201d\u00a0to restrict the extraction to the content from a web source.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<\/div><\/div><\/div><\/div><\/div><\/div><\/section><section class=\"l-section wpb_row height_auto\"><div class=\"l-section-h i-cf\"><div class=\"g-cols vc_row via_grid cols_1 laptops-cols_inherit tablets-cols_inherit mobiles-cols_1 valign_top type_default stacking_default\"><div class=\"wpb_column vc_column_container\"><div class=\"vc_column-inner\"><div class=\"w-post-elm post_navigation layout_simple inv_false\"><a class=\"post_navigation-item order_first to_prev\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/manage-indices\/how-to-simulate-indexing-stages\/\" title=\"Simulating Indexing Stages\"><div class=\"post_navigation-item-arrow\"><\/div><div class=\"post_navigation-item-meta\">Previous Post<\/div><div class=\"post_navigation-item-title\"><span>Simulating Indexing Stages<\/span><\/div><\/a><a class=\"post_navigation-item order_second to_next\" href=\"https:\/\/multisite.korebots.com\/SearchAssist\/concepts\/managing-relevance\/manage-relevance\/\" title=\"Managing Relevance\"><div class=\"post_navigation-item-arrow\"><\/div><div class=\"post_navigation-item-meta\">Next Post<\/div><div class=\"post_navigation-item-title\"><span>Managing Relevance<\/span><\/div><\/a><\/div><\/div><\/div><\/div><\/div><\/section>\n","protected":false},"excerpt":{"rendered":"Introduction The Configuration Workbench handles all the key aspects of the index configuration needed in transforming the available content into objects for effective indexing. An Indexing Pipeline is a series of indexing stages that prepares the content into a document compatible and ready for indexing. Each stage performs a specific set of transformations on the...","protected":false},"author":18,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[82],"tags":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts\/1851"}],"collection":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/comments?post=1851"}],"version-history":[{"count":23,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts\/1851\/revisions"}],"predecessor-version":[{"id":3662,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts\/1851\/revisions\/3662"}],"wp:attachment":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/media?parent=1851"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/categories?post=1851"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/tags?post=1851"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}