{"id":454,"date":"2021-05-13T08:55:38","date_gmt":"2021-05-13T08:55:38","guid":{"rendered":"https:\/\/multisite.korebots.com\/SearchAssist\/?p=454"},"modified":"2021-06-28T07:49:31","modified_gmt":"2021-06-28T07:49:31","slug":"web-content","status":"publish","type":"post","link":"https:\/\/multisite.korebots.com\/SearchAssist\/source-management\/content\/web-content\/","title":{"rendered":"Web Content"},"content":{"rendered":"

Organizations might already have a web page listing the features or product details that the search users might be looking for. Business users can leverage this information and enable the SearchAssist to respond to search user queries without replicating the data.\u00a0 <\/span><\/p>\n

SearchAssist allows for the content to be ingested into the application through web crawling. For example, consider a banking website. The banking website contains the bulk of the information that answers the search user queries. In this scenario, the SearchAssist application is configured to crawl the bank’s website and index all the web pages so that the indexed pages are retrieved to answer the search users\u2019 queries.<\/p>\n<\/div><\/div>

<\/div><\/div>

<\/span>Web Crawling<\/span><\/h2>\n

Web Crawling allows you to extract and index content from single or multiple websites to make the content ready for search. <\/span><\/p>\n

To crawl web domains, follow the below steps:<\/span><\/p>\n

    \n
  1. Log in to the application with valid credentials.<\/span><\/li>\n
  2. Click the <\/span>Indices <\/b>tab on the top.<\/span><\/li>\n
  3. On the left pane, under the <\/span>Sources <\/b>section, click <\/span>Content<\/b>.<\/span><\/li>\n
  4. On the Add Content page, click <\/span>Crawl Web Domain<\/b>.<\/span>
    \n\"\"<\/a><\/li>\n
  5. On the Crawl Web Domain dialog box, enter the domain URL in the <\/span>Source URL<\/b> field.<\/span><\/li>\n
  6. Enter a name in the <\/span>Source Title<\/b> field and a description in the <\/span>Description <\/b>field.<\/span><\/li>\n
  7. To schedule the web crawl, under the <\/span>Schedule <\/b>section, turn on the toggle.<\/span>\n