Subject Area Test Plan can be used to automate the ad-hoc report testing for different combinations of dimension attributes and fact measures in the selected subject areas. User can select the subject areas for testing along with the type of combination of tests that are of interest.
Usage tracking information of the BI connection is required for capturing Physical queries.
For information on the BI tools supported by the Subject Area Test Plan, please see here.
High-Level Steps for Adding a Subject Area Test Plan
Below are the high-level steps for adding a Subject Area Test Plan.
On the side menu, click Test Plans.
- Click Add New.
- In the New Test Plan page, select Subject Area Test Plan.
In the Properties page, do the following,
In the Basic Information screen, enter all the required details and click Next.
In the Options screen, complete the desired fields and click Save.
In the Home page, do the following:
Click Add test cases to add subject areas along with the type of combination of tests that interests you .
Click Run to execute the test plan.
Click the > arrow menu button (next to Home) and select Run History to view the test plan results and manage test run history.
Setting up and Working with Subject Area Test Plan
This section walks you through the pages and the detailed explanation of options in a Subject Area Test Plan.
Set up Properties
The Properties are divided into Basic Information and Options
In Basic Information, complete the following:
Test Plan Name
Enter a name for the Subject Area Test Plan.
Select a OBIEE connection from the drop-down list.
Create a label for easy identification and grouping of test plan. To create a label, click the Click to add label link, enter a name, and press Enter.
Enter a description for the test plan.
Select a user from the drop-down list.
BI Validator Groups
Select groups that can access the test plan. Only users within the selected group can view and work on this test plan.
In Options. complete any of the following:
Benchmark Selected Items. User can benchmark the selected data by selecting the checkbox.
Limit rows to fetch. Select this checkbox to limit rows to fetch after the items are benchmarked.
No of Rows. Specify the count of records to fetch.
Add Subject Areas
In this page, user can select the subject areas for testing along with the type of combination of tests that are of interest.
The following combination of logical queries are available :
Dimension Attributes Only. One logical query is generated for each dimension folder. A separate logical query is generated for the sub folders.
Fact Measures Only. One logical query for each folder containing measures. All the measures in the folder will be part of the logical query.
Single Dimension to Single Fact Table. One logical query for each of the dimension folders with all attributes and one measure at a time. For example, if there are 5 dimension folders in a subject area and 10 measures, 50 logical query will be generated.
Single Dimension to Multiple Fact Table. One logical query for each of the dimension folders with all attributes and all measures from fact folder.
Multiple Dimension to Single Fact Table. One attribute from each of the dimension folder is selected along with one measure at a time from the fact folder.
Multiple Dimension to Multiple Fact Table. One attribute from each of the dimension folder with all attributes and all measures from fact folder.
Additional Tasks Post Test Case Addition
After the test cases are added, you can perform the following additional tasks:
Allows you to refresh the count of subject areas selected/unselected for test types.
Allows you to benchmark subject areas.
Displays tables and columns present in the selected subject areas.
Benchmarked data can be compared with the latest selected data and the differences are shown in the pop up when clicking the Show Differences button.
Allows you to set up email addresses of the recipients for whom you want to send notifications about the test plan. To configure notifications, click More available besides the Home button at the right-hand side and select Notify.
Schedule Test Plan
Allows you to schedule test plan run process at specified time/date selected from the schedule window. To schedule test plan, click More available besides the Home button at the right-hand side and select Schedule.
Run Subject Area Test Plan
After the subject areas are added, you run the Subject Area Test Plan. After adding the test cases, you click the Run button on the Home page to execute test cases. When you click Run, you will be navigated to the Run page, where you will need to click either Run or Run Test Cases. By any chance if you are not in the Home page, click More available besides the Home button at the right-hand side and select Run. At any point, you can click the Stop button to stop the on-going execution of the the test cases.
The logical queries and physical queries of selected items are generated and shown with View links. Physical Queries are captured only if the BI Connection has usage tracking configured. The result data gets saved when ever the Subject Area Test Plan is executed.
Additional Tasks Post Test Plan Execution
After the test plan is run, you can perform the following additional tasks:
Click the View link to view Logical query.
Click the View link to view Physical query. If there is no Physical Query in the usaging tracking table, an error is produced.
In this column, click the View link to view Query result.
Allows users to add/edit comments by clicking the Edit link available under the Disposition column.
The Subject Area Test Plan executes the logical queries and checks for the following errors:
Are the logical queries returning any ODBC errors?
Does the physical query generated have any CAST AS NULL problems which usually means join issues in the RPD. This problem is usually difficult to detect because the report does not return errors. Usage tracking has to be available and configured in the BI connection for this feature to work.
View Run History
In this page, the run history of the test plan is shown. Different time stamps of the test plan are available on the left-hand side. Each time stamp indicates when the test plan was run. By default, the latest Test Plan run details are shown. To view previous runs details, select a particular time stamp that interests you. Each run time stamp displays counts for all status, passed, fail, warning, error and running status. When selecting any status count, dashboards will be shown based on the selected status category.
To view Run History, click More available besides the Home button at the right-hand side and select Run History.
This page contains the following options:
Click the Refresh icon to refresh test plan results.
Select the time stamp and click the Delete icon to remove the test run.
Click the Delete All icon to remove the complete test run history.
© Datagaps. All rights reserved.
Send feedback on this topic to Datagaps Support