{"id":124,"date":"2021-01-19T09:55:05","date_gmt":"2021-01-19T09:55:05","guid":{"rendered":"https:\/\/multisite.korebots.com\/SearchAssist\/?p=124"},"modified":"2021-07-16T03:51:06","modified_gmt":"2021-07-16T03:51:06","slug":"workbench","status":"publish","type":"post","link":"https:\/\/multisite.korebots.com\/SearchAssist\/manage-index\/workbench\/","title":{"rendered":"Workbench"},"content":{"rendered":"<section class=\"l-section wpb_row height_auto\"><div class=\"l-section-h i-cf\"><div class=\"g-cols vc_row via_grid cols_1 laptops-cols_inherit tablets-cols_inherit mobiles-cols_1 valign_top type_default stacking_default\"><div class=\"wpb_column vc_column_container\"><div class=\"vc_column-inner\"><div class=\"wpb_text_column\"><div class=\"wpb_wrapper\"><p><span style=\"font-weight: 400;\">Workbench combines the key aspects of the data indexing configuration process for <\/span><span style=\"font-weight: 400;\">transforming the content from data sources into objects for indexing.<br \/>\nAn Index Pipeline transforms the content into a document suitable for indexing. It consists of a series of configurable index pipeline stages. Each stage performs a different transformation on the data before passing the result to the next stage in the pipeline. For example, you can extract the entity values before processing trait properties. <\/span><span style=\"font-weight: 400;\">SearchAssist provides a built-in pipeline that allows Index Workbench to develop custom index pipelines to suit any application.\u00a0<\/span><\/p>\n<\/div><\/div><div class=\"wpb_text_column\"><div class=\"wpb_wrapper\"><p><a ref=\"magnificPopup\" href=\"http:\/\/docs.kore.ai\/searchassist\/wp-content\/uploads\/sites\/4\/2021\/01\/indices_pipline.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1259\" src=\"http:\/\/docs.kore.ai\/searchassist\/wp-content\/uploads\/sites\/4\/2021\/01\/indices_pipline.png\" alt=\"\" width=\"1120\" height=\"427\" \/><\/a><\/p>\n<\/div><\/div><div class=\"w-separator size_small with_line width_default thick_1 style_solid color_border align_center\"><div class=\"w-separator-h\"><\/div><\/div><div class=\"wpb_text_column\"><div class=\"wpb_wrapper\"><h2><span class=\"ez-toc-section\" id=\"Index_Pipeline_Stages\"><\/span>Index Pipeline Stages<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The data transformation is done in a series of operations called stages. SearchAssist provides many specialized index stages and custom script stages that allow custom processing. Each stage has a stage-specific configuration. You can order the stages in your preferred flow.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">A pipeline stage consists of properties like stage type, stage name, and condition. <\/span><span style=\"font-weight: 400;\">You can write conditions to choose the documents that must be transformed. For example, you can write a condition to select only FAQs.<br \/>\nRemember to <strong>Train your app<\/strong> each time you make changes to any index configuration. This would build the index based on the updated configurations.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In case you want to test the application for select stages and not all, you can choose to render a particular stage <strong>inactive<\/strong>. This will retain the stage but at the same time, it won&#8217;t be considered for index configuration. You can make the stages active at a later time as per your needs.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Index pipeline stages are listed below:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">The <strong>Field Mapping<\/strong> stage is used to map fields in an index pipeline document to a target field, set values, copy values, remove fields, and much more. <a href=\"\/SearchAssist\/lifecycle\/manage-index\/field-mapping\/\">Refer here for details<\/a>.<\/span><\/li>\n<li style=\"font-weight: 400;\"><strong>Keyword Extraction <\/strong><span style=\"font-weight: 400;\">is a technique to automatically detect important words from the text stored in a field. <a href=\"\/SearchAssist\/lifecycle\/manage-index\/keyword-extraction\/\">Refer here for details<\/a>.<\/span><\/li>\n<li style=\"font-weight: 400;\"><strong>Traits Extraction <\/strong><span style=\"font-weight: 400;\">extracts specific entities, attributes, or details that the search users might express in their conversations. <a href=\"\/SearchAssist\/lifecycle\/manage-index\/traits-extraction\/\">Refer here for details<\/a>.<\/span><\/li>\n<li style=\"font-weight: 400;\"><strong>Entity Extraction <\/strong><span style=\"font-weight: 400;\">uses NLP techniques to identify named entities from the source field. <a href=\"\/SearchAssist\/lifecycle\/manage-index\/entity-extraction\/\">Refer here for details<\/a>.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\"><strong>Semantic Meaning<\/strong> <\/span><span style=\"font-weight: 400;\">analysis is the technique to understand the meaning and interpretation of words, signs, and sentence structure. <a href=\"\/SearchAssist\/lifecycle\/manage-index\/semantic-meaning\/\">Refer here for details<\/a>.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\"><strong>Custom Script<\/strong> <\/span><span style=\"font-weight: 400;\">stage allows you to enter customized scripts to perform any field mapping tasks like deleting or renaming fields. <a href=\"\/SearchAssist\/lifecycle\/manage-index\/custom-script\/\">Refer here for details<\/a>.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\"><strong>Exclude Document<\/strong> <\/span><span style=\"font-weight: 400;\">stage drops all the documents that match the specified condition. <a href=\"\/SearchAssist\/lifecycle\/manage-index\/exclude-document\/\">Refer here for details<\/a>.<\/span><\/li>\n<\/ul>\n<\/div><\/div><div class=\"w-separator size_small with_line width_default thick_1 style_solid color_border align_center\"><div class=\"w-separator-h\"><\/div><\/div><div class=\"wpb_text_column\"><div class=\"wpb_wrapper\"><h2><span class=\"ez-toc-section\" id=\"Simulate\"><\/span>Simulate<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The Workbench is bundled with a Simulator that provides an interactive preview of how stage rules affect a document before it is indexed.<\/span><\/p>\n<p><span style=\"font-weight: 400;\"> You can simulate the index stage execution of sample documents using the Simulate button. The stages up to the one selected would be implemented. For example, if you have three stages Traits, Webdomain Keyword, and FAQ Keyword Extraction in that order and you hit Simulate in Webdomain keywords stage then the simulation would extract Traits and Webdomain keywords.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1413\" src=\"http:\/\/docs.kore.ai\/searchassist\/wp-content\/uploads\/sites\/4\/2021\/01\/workbench_simulate.png\" alt=\"\" width=\"1113\" height=\"701\" \/><\/p>\n<p><span style=\"font-weight: 400;\">The simulated result highlights the impacted fields and allows you to see the fields available in the document.<\/span><br \/>\n<img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1414\" src=\"http:\/\/docs.kore.ai\/searchassist\/wp-content\/uploads\/sites\/4\/2021\/01\/workbench_simulate1.png\" alt=\"\" width=\"399\" height=\"701\" \/><\/p>\n<\/div><\/div><div class=\"w-separator size_small with_line width_default thick_1 style_solid color_border align_center\"><div class=\"w-separator-h\"><\/div><\/div>[vc_raw_html]JTNDZGl2JTIwY2xhc3MlM0QlMjJ3LXBvc3QtZWxtJTIwcG9zdF9uYXZpZ2F0aW9uJTIwbGF5b3V0X3NpbXBsZSUyMGludl9mYWxzZSUyMiUzRSUwQSUwOSUzQ2ElMjBjbGFzcyUzRCUyMnBvc3RfbmF2aWdhdGlvbi1pdGVtJTIwb3JkZXJfZmlyc3QlMjB0b19wcmV2JTIyJTIwaHJlZiUzRCUyMiUyRlNlYXJjaEFzc2lzdCUyRm1hbmFnZS1pbmRleCUyRmluZGV4LW1hbmFnZW1lbnQlMkYlMjIlM0UlM0MlMkZwJTNFJTBBJTNDZGl2JTIwY2xhc3MlM0QlMjJwb3N0X25hdmlnYXRpb24taXRlbS1hcnJvdyUyMiUzRSUzQyUyRmRpdiUzRSUwQSUzQ2RpdiUyMGNsYXNzJTNEJTIycG9zdF9uYXZpZ2F0aW9uLWl0ZW0tbWV0YSUyMiUzRVByZXZpb3VzJTNDJTJGZGl2JTNFJTBBJTNDZGl2JTIwY2xhc3MlM0QlMjJwb3N0X25hdmlnYXRpb24taXRlbS10aXRsZSUyMiUzRSUzQ3NwYW4lM0VJbmRleCUyME1hbmFnZW1lbnQlM0MlMkZzcGFuJTNFJTNDJTJGZGl2JTNFJTBBJTNDcCUzRSUzQyUyRmElM0UlM0NiciUyMCUyRiUzRSUwQSUzQ2ElMjBjbGFzcyUzRCUyMnBvc3RfbmF2aWdhdGlvbi1pdGVtJTIwb3JkZXJfc2Vjb25kJTIwdG9fbmV4dCUyMiUyMGhyZWYlM0QlMjIlMkZTZWFyY2hBc3Npc3QlMkZzZWFyY2gtZXhwZXJpZW5jZSUyRmRlc2lnbi1zZWFyY2gtZXhwZXJpZW5jZSUyRiUyMiUzRSUzQyUyRnAlM0UlMEElM0NkaXYlMjBjbGFzcyUzRCUyMnBvc3RfbmF2aWdhdGlvbi1pdGVtLWFycm93JTIyJTNFJTNDJTJGZGl2JTNFJTBBJTNDZGl2JTIwY2xhc3MlM0QlMjJwb3N0X25hdmlnYXRpb24taXRlbS1tZXRhJTIyJTNFTmV4dCUzQyUyRmRpdiUzRSUwQSUzQ2RpdiUyMGNsYXNzJTNEJTIycG9zdF9uYXZpZ2F0aW9uLWl0ZW0tdGl0bGUlMjIlM0VSZXN1bHQlMjBPcHRpbWl6YXRpb24lM0MlMkZkaXYlM0UlMEElM0NwJTNFJTNDJTJGYSUzRSUzQyUyRmRpdiUzRSUwQQ==[\/vc_raw_html]<div class=\"w-separator size_small with_line width_default thick_1 style_solid color_border align_center\"><div class=\"w-separator-h\"><\/div><\/div><\/div><\/div><\/div><\/div><\/section>\n","protected":false},"excerpt":{"rendered":"Workbench combines the key aspects of the data indexing configuration process for transforming the content from data sources into objects for indexing. An Index Pipeline transforms the content into a document suitable for indexing. It consists of a series of configurable index pipeline stages. Each stage performs a different transformation on the data before passing...","protected":false},"author":12,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts\/124"}],"collection":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/comments?post=124"}],"version-history":[{"count":16,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts\/124\/revisions"}],"predecessor-version":[{"id":1241,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/posts\/124\/revisions\/1241"}],"wp:attachment":[{"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/media?parent=124"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/categories?post=124"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/multisite.korebots.com\/SearchAssist\/wp-json\/wp\/v2\/tags?post=124"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}