Share:

Subject Area Test Plan can be used to automate the ad-hoc report testing for different combinations of dimension attributes and fact measures in the selected subject areas. User can select the subject areas for testing along with the type of combination of tests that are of interest.

Information Usage tracking information of the BI connection is required for capturing Physical queries. 

For information on the BI tools supported by the Subject Area Test Plan, please see here


High-Level Steps for Adding a Subject Area Test Plan

Below are the high-level steps for adding a Subject Area Test Plan.

  1. On the side menu, click Test Plans.  
  2. Click Add New.
  3. In the New Test Plan page, select Subject Area Test Plan.
  4. In the Properties page, do the following,
    1. In the Basic Information screen, enter all the required details and click Next
    2. In the Options screen, complete the desired fields and click Save.
  5. In the Home page, do the following:
    1. Click Add test cases to add subject areas along with the type of combination of tests that interests you .
    2. Click Run to execute the test plan. 
  6. Click the arrow menu button (next to Home) and select Run History to view the test plan results and manage test run history.

Setting up and Working with Subject Area Test Plan

This section walks you through the pages and the detailed explanation of options in a Subject Area Test Plan.

Set up Properties

The Properties are divided into Basic Information and Options

Basic Information

In Basic Information, complete the following:

Test Plan Name

Enter a name for the Subject Area Test Plan.

Connection

Select a OBIEE connection from the drop-down list.

Label

Create a label for easy identification and grouping of test plan. To create a label, click the Click to add label link, enter a name, and press Enter

Description

Enter a description for the test plan.

User

Select a user from the drop-down list.

BI Validator Groups

Select groups that can access the test plan. Only users within the selected group can view and work on this test plan. 

Options

In Options. complete any of the following:

  • Benchmark Selected Items. User can benchmark the selected data by selecting the checkbox. 
  • Limit rows to fetch. Select this checkbox to limit rows to fetch after the items are benchmarked. 
  • No of Rows. Specify the count of records to fetch.

Add Subject Areas

In this page, user can select the subject areas for testing along with the type of combination of tests that are of interest.

The following combination of logical queries are available :

  • Dimension Attributes Only. One logical query is generated for each dimension folder. A separate logical query is generated for the sub folders.
  • Fact Measures Only. One logical query for each folder containing measures. All the measures in the folder will be part of the logical query.
  • Single Dimension to Single Fact Table. One logical query for each of the dimension folders with all attributes and one measure at a time. For example, if there are 5 dimension folders in a subject area and 10 measures, 50 logical query will be generated.
  • Single Dimension to Multiple Fact Table. One logical query for each of the dimension folders with all attributes and all measures from fact folder.
  • Multiple Dimension to Single Fact Table. One attribute from each of the dimension folder is selected along with one measure at a time from the fact folder. 
  • Multiple Dimension to Multiple Fact Table. One attribute from each of the dimension folder with all attributes and all measures from fact folder.

Additional Tasks Post Test Case Addition 

After the test cases are added, you can perform the following additional tasks:

Refresh Counts

Allows you to refresh the count of subject areas selected/unselected for test types.                                                                                                       

Benchmark

Allows you to benchmark subject areas.

Show Data

Displays tables and columns present in the selected subject areas.

Differences

Benchmarked data can be compared with the latest selected data and the differences are shown in the pop up when clicking the Show Differences button. 

Configure Notifications

Allows you to set up email addresses of the recipients for whom you want to send notifications about the test plan. To configure notifications, click  More available besides the Home button at the right-hand side and select Notify.

Schedule Test Plan

Allows you to schedule test plan run process at specified time/date selected from the schedule window. To schedule test plan, click  More available besides the Home button at the right-hand side and select Schedule.

Run Subject Area Test Plan

After the subject areas are added, you run the Subject Area Test Plan. After adding the test cases, you click the Run button on the Home page to execute test cases. When you click Run, you will be navigated to the Run page, where you will need to click either Run or Run Test Cases. By any chance if you are not in the Home page, click  More available besides the Home button at the right-hand side and select Run. At any point, you can click the Stop button to stop the on-going execution of the the test cases.

The logical queries and physical queries of selected items are generated and shown with View links. Physical Queries are captured only if the BI Connection has usage tracking configured. The result data gets saved when ever the Subject Area Test Plan is executed.

Additional Tasks Post Test Plan Execution

After the test plan is run, you can perform the following additional tasks:

Logical Query

Click the View link to view Logical query. 

Physical Query

Click the View link to view Physical query. If there is no Physical Query in the usaging tracking table, an error is produced.

Query Result

In this column, click the View link to view Query result.

Disposition

Allows users to add/edit comments by clicking the Edit link available under the Disposition column.

Information Users in Multi-User environment can also run the test plan using the Command Line Interface.

The Subject Area Test Plan executes the logical queries and checks for the following errors: 

  1. Are the logical queries returning any ODBC errors? 
  2. Does the physical query generated have any CAST AS NULL problems which usually means join issues in the RPD. This problem is usually difficult to detect because the report does not return errors. Usage tracking has to be available and configured in the BI connection for this feature to work.

View Run History

In this page, the run history of the test plan is shown. Different time stamps of the test plan are available on the left-hand side. Each time stamp indicates when the test plan was run. By default, the latest Test Plan run details are shown.  To view previous runs details, select a particular time stamp that interests you.  Each run time stamp displays counts for all status, passed, fail, warning, error and running status. When selecting any status count, dashboards will be shown based on the selected status category.

To view Run History, click  More available besides the Home button at the right-hand side and select Run History.  

This page contains the following options:

Refresh

Click the  Refresh icon to refresh test plan results.

Delete

Select the time stamp and click the  Delete icon to remove the test run.

Delete All

Click the  Delete All icon to remove the complete test run history.

PreviousNext

© Datagaps. All rights reserved.
Send feedback on this topic to Datagaps Support