Share:

Data Profile Component is a basic unit used to build an ETL Test Case. It consists of a SQL query given by user for a database connection. The prerequisite for adding this component is that the Test Case should already have atleast one DB, Flat File, or View Component.


Adding a Data Profile Component

In the Design page of the Component Test Case, drag and drop the Data Profile Component from the right into the design area. In the Add Data Profile Component dialog that opens, enter a name for the Data Profile component in the Name field, select a database connection from the DB Connections drop-down list, and click Apply.

Opening a Data Profile Component

After running the Component Test Case, the components are created and are available in the Test Cases page. Click on the name of the Data Profile Component opens Component Test Case with the Design page displayed, where you can see the component added. Double-click the Data Profile Component to open it.

Information You can also open a test case from the TEST RUNS view.

Data Profile Component Details

After opening or creating the Data Profile Component, complete the information in the following pages:

Properties

In the Properties page, you enter the following:

Name

The name of the Data Profile Component.

Connection

The data source connection name of the Data Profile Component.

Result Table Name

The name of the table in which run results of the Data Profile Component are stored. 

Save Last Results

Select how many number of recent run results should be saved. You can save up to a maximum of 10 run results

Allow updates to Baseline

If selected, the baseline tables are also updated whenever there is a change in Data Profile Component run results.

Verification Status

When the component is executed successfully, the status is shown as "Verified". Otherwise, the status will be shown as "Not Verified".

Truncate result tables after run

Selecting this option empties the result tables after the component is run.

Query

In this page, you create and execute a query.

Execute Query

Allows you to execute the query and see results.

Execute Count Query

Allows you to view the actual count of result rows. 

Add Parameters

Allows you to add parameters to the query.

Build Query

Allows you to create a query using the data model defined for the database. If there is no data model, you can create one.

Set Timeout

Allows you to set timeout in minutes for the ETL Server to wait before the query produces results.

Columns

When you navigate to the Columns page, the columns are loaded automatically. If you want to reload the columns, click Load Columns. Select from the list on the right-hand side to peform aggregate functions on the columns.

Baseline

In the Baseline page, you baseline the columns loaded in the Columns page by clicking the Create Baseline button.

Validations

In the Validations page, you create a validation for Data Profile. To create a validation, click the plus icon and complete the following information:

Properties

In Properties tab, enter the basic details for the validation and select the data sets.

Name

Enter a name for the Data Profile Validation rule.

Description

Enter a description for Data Profile Validation rule.

Dataset A 

Select the table where the validation run data should be saved.

Dataset B

Select the table where the validation baseline data should be saved.

Mapping

In the Mapping page, you map columns in Dataset A with columns in Dataset B.

Allowed Variation (%)

Allow ETL Validator Server to pass the component with this much percentage of variation.

Save

Allows you to save the changes to the mappings.

Remap Columns by Name

Selecting this option will display the mappings by column name.

Remap Columns by Order

Selecting this option will display the mappings by column order.

PreviousNext

© Datagaps. All rights reserved.
Send feedback on this topic to Datagaps Support