Select Page

Data Profiling

Data profiling is the statistical analysis of a data set and is the first step in any successful data initiative. Frequently an organisation will not know the contents of data tables and columns, data profiling allows detailed information to be produced to inform the organisation of the data and its quality; whether it is fir for purpose.

Data profiling can also identify statistical outliers, nulls and defaulting of values, these values may not be accurate or the most up to data in the organisation and thus will identify areas that need more analysis, and possible remediation.

DQ Rule Books will profile your data using a range of complimentary techniques such as;

  • Format Distributions
  • Format Analysis
  • Length Analysis
  • Data Type Analysis
  • Uniqueness Analysis

Output

Compiled by experienced data quality analysts, the bespoke report will be tailored toward your requirements but will typically comprise, a table report, column report and an exceptions report.

Table Report

Approximately 4 pages long, this will give you an overview of all the data in the table, including:

Total number of rows

How many of the rows have a value in them

Minimum and Maximum values etc.

The majority of the data in this overall report is included in the Column Reports (described below) but having it all in one large table has the advantage that you can scan through everything as soon as you receive your report and get a quick overview. It also enables you to easily compare columns with one another.

Column Report

This will provide you with a detailed profile of your data, column by column. Data found within the Column report include;

  • Data Type
  • Frequency Distribution of Values
  • Null Counts
  • Unique Count
  • Minimum & Maximum Values for the Column
  • Format
  • Lengths of Values
  • Speace (separated from Null Counts)
Exception Report

Our trained data quality analyst’s will also drilldown on any unusual data, and will highlight any concerns for you in red in the ‘Exceptions Report’ .

Below is an example of a Data Profiling Report.

Please enter your details below and a member of the team will be in contact to discuss your requirements.