{"id":30951,"date":"2021-10-26T12:46:46","date_gmt":"2021-10-26T11:46:46","guid":{"rendered":"https:\/\/multisite.korebots.com\/v9-0\/?p=30951"},"modified":"2021-10-28T13:35:15","modified_gmt":"2021-10-28T12:35:15","slug":"conversation-testing","status":"publish","type":"post","link":"https:\/\/multisite.korebots.com\/v9-0\/docs\/bots\/test-your-bot\/conversation-testing\/","title":{"rendered":"Conversation Testing"},"content":{"rendered":"

Conversation Testing enables you to simulate end-to-end conversational flows to evaluate the dialog task or perform regression. You can create Test Cases to capture various business scenarios and run them at a later point in time to validate the performance of the bot.\u00a0<\/span><\/p>\n

<\/span>Test Cases<\/strong><\/span><\/h2>\n

Test Cases consist of a sequence of <\/span>Test Steps<\/b> that capture the conversational flow. Each Test Step is a combination of Step Number, Test Input, Expected Output, Actual Output, and Test Result.\u00a0<\/span><\/p>\n

Step#<\/b> defines the sequence of execution.\u00a0<\/span><\/p>\n

Test Input <\/b>represents the user message part of the conversation.\u00a0<\/span><\/p>\n

Expected Output<\/b> represents the bot message that is anticipated from the bot.<\/span><\/p>\n

Actual Output<\/b> represents the response of the bot during test execution. The platform will evaluate the Actual Output against the Expected Output to determine if a test step is passed or not.\u00a0<\/span><\/p>\n

Test Result<\/b> indicates if the actual output is the same as the expected output. Test Result can be Pass, Failed, or Not Executed.<\/span><\/p>\n

<\/span>Test Case Creation\u00a0<\/strong><\/span><\/h3>\n

New Test Cases can be created by recording the conversation while using \u2018<\/span>Talk to Bot<\/span><\/a>\u2019. Follow the following steps to create a new test case.\u00a0<\/span><\/p>\n

Step 1:<\/strong> Launch \u2018Talk to Bot\u2019 by clicking on the icon in the bottom right corner of your screen. \u2018Talk to Bot\u2019 can be launched from any module on the platform.\u00a0<\/span><\/p>\n

\"\"<\/strong><\/span><\/p>\n

Step 2:<\/strong> Click on \u2018Record Conversation\u2019 to start recording the messages that are going to be part of the test case.\u00a0<\/span><\/p>\n

\"\"<\/strong><\/span><\/p>\n

Step 3:<\/strong> Interact with the bot by entering relevant user messages.\u00a0<\/span><\/p>\n

Step 4:<\/strong> To create a new test case, click on \u2018Stop Recording\u2019 and then click on \u2018Create Test Case\u2019.\u00a0<\/span><\/p>\n

Step 5:<\/strong> In the next screen, add the necessary details such as \u2018Test Case Name\u2019, \u2018Description\u2019 and \u2018Tags\u2019 and click on \u2018Add\u2019.<\/span><\/p>\n

Step 6:<\/strong> Navigate to the Conversation Testing module to execute the added test case or add another test case by following the same steps.\u00a0<\/span><\/p>\n

<\/span>Tags<\/strong><\/span><\/h3>\n

Tags help in classifying and organizing test cases. You can choose to add a tag at the time of the creation of a test case or from the \u2018General Settings\u2019 under the Test Case properties.<\/span><\/p>\n

\/\/ScreenShot<\/span><\/p>\n

<\/span>General Settings<\/strong><\/span><\/h3>\n

\u00a0After a test case is created, you can access the \u2018General Settings\u2019 from the overflow menu. The General Settings has a few editable and few view-only properties.<\/span><\/p>\n

\/\/Screensshot<\/p>\n

You have the option to edit the following properties.<\/span><\/p>\n

    \n
  • \u00a0 \u00a0 \u00a0 <\/span>Test Case Name<\/span><\/li>\n
  • \u00a0 \u00a0 \u00a0 <\/span>Test Case Description<\/span><\/li>\n
  • \u00a0 \u00a0 \u00a0 <\/span>Test Case Tags<\/span><\/li>\n<\/ul>\n

    Additionally, the following properties can be viewed but not edited.<\/span><\/p>\n

      \n
    • \u00a0 \u00a0 \u00a0 <\/span>Date & Time of Test Case Creation<\/span><\/li>\n
    • \u00a0 \u00a0 \u00a0 <\/span>Name of the User who created the Test Case<\/span><\/li>\n
    • \u00a0 \u00a0 \u00a0 <\/span>Date & Time of the last update<\/span><\/li>\n
    • \u00a0 \u00a0 \u00a0 <\/span>Name of the user who last updated the test case<\/span><\/li>\n<\/ul>\n

      <\/span>Test Case Execution<\/strong><\/span><\/h2>\n

      The following steps will guide you on how to execute a test case and obtain a detailed analytical report based on the execution.\u00a0<\/span><\/p>\n

      Step 1:<\/strong> Select the Test Cases that you would like to execute.<\/span><\/p>\n

      Step 2:<\/strong> Click on \u2018Run Test Case\u2019 to start the execution.\u00a0<\/span><\/p>\n

      Step 3:<\/strong> Next, you are required to choose the Version of the Bot that you want to test. Based on the version selected, please ensure that you have valid authorization tokens for the bot to make the service calls that would be part of the test case.\u00a0<\/span><\/p>\n

      Please note that the test case executions are asynchronous in nature, and the test cases will get executed one at a time.\u00a0<\/span><\/p>\n

      Step 4:<\/strong> You can monitor the progress of the execution from the last result column against the test case and the status docker.\u00a0<\/span><\/p>\n

      Step 5:<\/strong> Once the test case execution is over, you can click on the test case to view the execution history.\u00a0<\/span><\/p>\n

      Step 6:<\/strong> Click on any of the listed test runs to view the details of the test run.\u00a0<\/span><\/p>\n

      Test Cases are executed asynchronously i.e. even when multiple test cases are selected, the execution happens sequentially. You have the option to cancel the test execution before the execution is completed.\u00a0<\/span><\/p>\n

      Once the test case execution has started, the platform continues to execute the test case even when one or more test steps fail. However, if the test execution is stuck at a test step for more th<\/span>an 60s the platform will timeout and abort the execution.\u00a0<\/span><\/p>\n

      <\/span>Interpreting Test Results<\/strong><\/span><\/h3>\n

      The following details are stored against every test execution.\u00a0<\/span><\/p>\n

      \/\/screenshot<\/p>\n

        \n
      • Date & Time of Execution completion.<\/span><\/li>\n
      • Version Type to indicate if the test case was run against the In-development or the Published version of the bot.\u00a0<\/span><\/li>\n
      • Execution Result to indicate the result of the execution. A test case is treated as failed if at least one of the test steps is failed.\u00a0<\/span><\/li>\n
      • Execution Time indicates the total time duration of the execution.\u00a0<\/span><\/li>\n
      • Test Step Details represent the total steps that were passed, failed, or not executed.\u00a0<\/span><\/li>\n
      • Execution Error Details are shown only when the platform is unable to complete the test execution either because of the user aborting the test case or the test step timing out due to an error.\u00a0<\/span><\/li>\n<\/ul>\n

        <\/span>Limitations<\/strong><\/span><\/h2>\n

        The following modules cannot be tested with the current version of conversation testing.\u00a0<\/span><\/p>\n

          \n
        • Digital Forms<\/span><\/li>\n
        • Dynamically generated bot messages where content or context variables are used.<\/span><\/li>\n<\/ul>\n

           <\/p>\n

           <\/p>\n","protected":false},"excerpt":{"rendered":"

          Conversation Testing enables you to simulate end-to-end conversational flows to evaluate the dialog task or perform regression. You can create Test Cases to capture various business scenarios and run them at a later point in time to validate the performance of the bot.\u00a0 Test Cases Test Cases consist of a sequence of Test Steps that…<\/p>\n","protected":false},"author":20,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[39],"tags":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/multisite.korebots.com\/v9-0\/wp-json\/wp\/v2\/posts\/30951"}],"collection":[{"href":"https:\/\/multisite.korebots.com\/v9-0\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/multisite.korebots.com\/v9-0\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/multisite.korebots.com\/v9-0\/wp-json\/wp\/v2\/users\/20"}],"replies":[{"embeddable":true,"href":"https:\/\/multisite.korebots.com\/v9-0\/wp-json\/wp\/v2\/comments?post=30951"}],"version-history":[{"count":9,"href":"https:\/\/multisite.korebots.com\/v9-0\/wp-json\/wp\/v2\/posts\/30951\/revisions"}],"predecessor-version":[{"id":30958,"href":"https:\/\/multisite.korebots.com\/v9-0\/wp-json\/wp\/v2\/posts\/30951\/revisions\/30958"}],"wp:attachment":[{"href":"https:\/\/multisite.korebots.com\/v9-0\/wp-json\/wp\/v2\/media?parent=30951"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/multisite.korebots.com\/v9-0\/wp-json\/wp\/v2\/categories?post=30951"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/multisite.korebots.com\/v9-0\/wp-json\/wp\/v2\/tags?post=30951"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}