Data Profile Component is a basic unit used to build an ETL Test Case. It consists of a SQL query given by user for a database connection. The prerequisite for adding this component is that the Test Case should already have atleast one DB, Flat File, or View Component.
Adding a Data Profile Component
In the Design page of the Component Test Case, drag and drop the Data Profile Component from the right into the design area. In the Add Data Profile Component dialog that opens, enter a name for the Data Profile component in the Name field, select a database connection from the DB Connections drop-down list, and click Apply.
Opening a Data Profile Component
After running the Component Test Case, the components are created and are available in the Test Cases page. Click on the name of the Data Profile Component opens Component Test Case with the Design page displayed, where you can see the component added. Double-click the Data Profile Component to open it.
You can also open a test case from the TEST RUNS view.
Data Profile Component Details
After opening or creating the Data Profile Component, complete the information in the following pages:
In the Properties page, you enter the following:
The name of the Data Profile Component.
The data source connection name of the Data Profile Component.
Result Table Name
The name of the table in which run results of the Data Profile Component are stored.
Save Last Results
Select how many number of recent run results should be saved. You can save up to a maximum of 10 run results
Allow updates to Baseline
If selected, the baseline tables are also updated whenever there is a change in Data Profile Component run results.
When the component is executed successfully, the status is shown as "Verified". Otherwise, the status will be shown as "Not Verified".
Truncate result tables after run
Selecting this option empties the result tables after the component is run.
In this page, you create and execute a query.
Allows you to execute the query and see results.
Execute Count Query
Allows you to view the actual count of result rows.
Allows you to add parameters to the query.
Allows you to create a query using the data model defined for the database. If there is no data model, you can create one.
Allows you to set timeout in minutes for the ETL Server to wait before the query produces results.
When you navigate to the Columns page, the columns are loaded automatically. If you want to reload the columns, click Load Columns. Select from the list on the right-hand side to peform aggregate functions on the columns.
In the Baseline page, you baseline the columns loaded in the Columns page by clicking the Create Baseline button.
In the Validations page, you create a validation for Data Profile. To create a validation, click the plus icon and complete the following information:
In Properties tab, enter the basic details for the validation and select the data sets.
Enter a name for the Data Profile Validation rule.
Enter a description for Data Profile Validation rule.
Select the table where the validation run data should be saved.
Select the table where the validation baseline data should be saved.
In the Mapping page, you map columns in Dataset A with columns in Dataset B.
Allowed Variation (%)
Allow ETL Validator Server to pass the component with this much percentage of variation.
Allows you to save the changes to the mappings.
Remap Columns by Name
Selecting this option will display the mappings by column name.
Remap Columns by Order
Selecting this option will display the mappings by column order.
© Datagaps. All rights reserved.
Send feedback on this topic to Datagaps Support