Share:

A Data Compare Test Plan provides the capability to compare the data of a report with another report, a database query, or Excel file. You can compare reports in Data format or PDF format.

The following two comparison methods are possible in a Data Compare Test Plan:

Report to Report Data Comparison

A Data Compare Test Plan can be used to map and compare data of two completely different reports. These reports can exist in different folder structures and have different columns names residing in different environments. They can even belong to two different BI reporting tools such as OBIEE, Cognos, Business Objects, or Tableau. This method allows for Data and PDF comparison types

Use Cases: This feature is helpful in testing reports when re-designing your BI reporting (e.g. redesign of your RPD). Another use case is for testing of reports when reporting from one reporting tool to another.

Report to Database Query Data Comparison

Data Compare Test Plan also supports comparing the report data with the output of a database query. ODBC data sources can be added to BI Validator so that queries can be run against these sources to compare the output with the report data. You can also compare the report data with Excel as data source.

Use Cases: This feature is helpful for performing an end-to-end test of the report data. In a data warehouse scenario, this feature is helpful in comparing data from source database with the report data.

For information on the BI tools supported by the Data Compare Test Plan, please see here


High-Level Steps for Adding a Data Compare Test Plan

Below are the high-level steps for adding a Data Compare Test Plan.

  1. On the side menu, click Test Plans.  
  2. Click Add New.
  3. In the New Test Plan page, select Data Compare Test Plan.
  4. In the Properties page, do the following,
    1. In the Basic Information screen, enter all the required details and click Next
    2. In the Options screen, complete the desired fields and click Save.
  5. In the Home pagedo the following:
    1. Click Add test cases to add reports/documents to the test plan.
    2. Click Run to execute the test plan. 
  6. Click the > arrow menu button (next to Home) and select Run History to view the test plan results and manage test run history.

Setting up and Working with Data Compare Test Plan

This section walks you through the pages and the detailed explanation of options in a Data Compare Test Plan.

Set up Properties

The Properties are divided into Basic Information and Options.

Basic Information

In Basic Information, complete the following:

Test Plan Name

Enter a name for the Data Compare Test Plan.

Comparison Type

Select the method to compare the data. Available methods are ReporttoReport and ReporttoQuery.

Connection One

Select the first connection of the BI tool.

Connection Two

Select the second connection of the BI tool.

BI Validator Groups

Assign group(s) to the test plan. Groups selected here will allow users part of those groups to access the test plan.

Label

Create a label for easy identification and grouping of test plan. To create a label, click the Click to add label link, enter a name, and press Enter.

Options

In Options, complete any of the following:

  • Row Count. Enter a number to display only that many number of rows. For PDF comparison, row count is not required.
  • Time Out.  If the report running exceeds the time specified, it will show as timeout.

Add Test Cases

In the Home page, Test Cases are added. If the comparison type is Report to Report, you will be shown options for Data and PDF comparison types. In case of Report to Query, you will be shown Data comparison option only. To add reports, click the Add Data Comparison or Add Pdf Comparison button and add reports for source and target.

 How to Add Reports for Data Comparison in a Data Compare Test Plan?         

You add reports as source and target for Report to Report or Report to Query Data comparison in a Data Compare Test Plan. The following steps will walk you through the procedure to add reports using the Add Data Comparison button available in the Add Reports page of the Data Compare Test Plan.

  1. From within the Add Reports page of the Data Compare Test Plan, click Add Reports at the bottom.
  2. In the wizard that opens with the Report page selected, drag reports from the BI connection tree into the source area. Similarly, drag reports from the BI connection tree into the target area. You can also add reports by clicking the + plus icon and Import button (if you have report links in a text file). 
    • Row Count. Number of records to fetch for a report. By default, the first 100 records are shown when the report is added.
    • Set Timeout. If the report running exceeds the time specified, it will show as time out. 
  3. Click Next to continue.
  4. In the Query page, queries for Source and Target are displayed for further customization. Simply type in functions to the existing queries or click Query Builder to write queries by selecting rules and conditions. 
       
  5. Click Next to continue.
  6. In the Mapping page, drag columns from Source and Target for mapping and creating joins. 

  7. Click Next to continue.
  8. In the Test Run page, click Run to run the report. Allow sufficient time for the report(s) to execute. Any differences available are shown using a View link in the Result column.
  9. If the results are satisfactory, click Close at the bottom. If you are prompted to save the test run, click OK. The test case (report) is added to the Add Reports page. If not, click Back and revise the queries or mappings as necessary.

How to Add Reports for PDF Comparison in a Data Compare Test Plan?   

You add reports as source and target for Report-to-Report PDF Comparison in the Data Compare Test Plan. The following steps will walk you through the procedure to add reports using the Add Pdf Comparison button available in the Home page of the Data Compare Test Plan.


  1. From within the Home page of the Data Compare Test Plan, click Add Pdf Comparison at the top.
  2. In the wizard that opens with the Report page selected, drag reports from the BI connection tree into the source area. Similarly, drag reports from the BI connection tree into the target area . You can also add reports by clicking the + plus icon and Import button (if you have report links in a text file). 
    • Set Timeout. If the report running exceeds the time specified, it will show as time out. 
  3. Click Next to continue.
  4. In the Test Run page, click Run to run the report. Allow sufficient time for the report(s) to execute. Any differences available are shown using a View link in the Result column.
  5. If the results are satisfactory, click Close at the bottom. If you are prompted to save the test run, click OK. The test case (report) is added to the Add Reports page. If necessary, click Back and make changes to report selections.

Delete

Click the delete icon to remove the selected reports from the test plan.

Configure Notifications

Allows you to set up email addresses of the recipients for whom you want to send notifications about the test plan. To configure notifications, click  More available besides the Home button at the right-hand side and select Notify.

Schedule Test Plan

Allows you to schedule test plan run process at specified time/date selected from the schedule window. To schedule test plan, click  More available besides the Home button at the right-hand side and select Schedule.

Run Data Compare Test Plan

In this page, the test plan is executed. After adding the test cases, you click the Run button on the Home page to execute test cases. When you click Run, you will be navigated to the Run page, where you will need to click either Run or Run Test Cases. By any chance if you are not in the Home page, click  More available besides the Home button at the right-hand side and select Run. At any point, you can click the Stop button to stop the ongoing execution of the test cases.  

Upon execution of test cases, the differences can be seen by clicking the View link under the Result column. Clicking the View link opens a differences window and provides the source target, matched and unmatched data. 

Information Users in Multi-User environment can also run the test plan using the  Command Line Interface.

View Run History

In this page, the run history of the test plan is shown. Different time stamps of the test plan are available on the left-hand side. Each time stamp indicates when the test plan was run. By default, the latest Test Plan run details are shown. To view previous runs details, select a particular time stamp that interests you. Each run time stamp displays counts for passed, fail, warning, error and running status. When selecting any status count, dashboards will be shown based on the selected status category.

The Results page contains the following:

Refresh

Click the  Refresh icon to refresh test plan results.

Delete

Select the time stamp and click the  Delete icon to remove the test run.

Delete All

Click the  Delete All icon to remove the complete test run history.

Information The procedure to run the Data Compare Test Plan for Report to Query comparison is same except that a database query is required on the Target side.

PreviousNext

© Datagaps. All rights reserved.
Send feedback on this topic to Datagaps Support