Analyzing and Cleansing Data for Sun Master Index

The topics listed here provide task, conceptual, and reference information for generating the Data Profiler and Data Cleanser and using those tools to analyze and cleanse legacy data.

Note that Java CAPS includes two versions of Sun Master Index. Sun Master Index (Repository) is installed in the Java CAPS repository and provides all the functionality of previous versions in the new Java CAPS environment. Sun Master Index is a service-enabled version of the master index that is installed directly into NetBeans. It includes all of the features of Sun Master Index (Repository) plus several new features, like data analysis, data cleansing, data loading, and an improved Data Manager GUI. Both products are components of the Sun Master Data Management (MDM) Suite. This document was created for Sun Master Index, but Sun Master Index (Repository) can be adapted to use the tools.

What You Need to Know

These topics provide information you should to know before you start working with the Data Profiler and Data Cleanser.

• About the Data Profiler

• About the Data Cleanser

• Data Cleansing and Profiling Process Overview

• Required Format for Flat Data Files

What You Need to Do

These topics provide instructions on how to generate the Data Profiler and Data Cleanser, and how to configure and use the tools to analyze and transform legacy data.

• Configuring the Environment

• Generating the Data Profiler and Data Cleanser

• Extracting the Legacy Data

• Determining the Fields to Analyze

• Defining the Data Analysis Rules

• Performing the Initial Data Analysis

• Reviewing the Data Profiler Reports

• Configuring the Data Cleansing Rules

• Cleansing the Legacy Data

• Performing Frequency Analyses on Cleansed Data

• Adjust the Master Index Configuration

More Information

These topics provide additional information you should know when working with the Data Profiler and Data Cleanser.

• Data Profiler Processing Attributes

• Data Profiler Global Variables

• Simple Frequency Analysis Rules

• Constrained Frequency Analysis Rules

• Pattern Frequency Analysis Rules

• Data Cleanser Processing Attributes

• Data Cleanser Global Variables

• Data Validation Rules

• Data Transformation Rules

• Conditional Data Rules

• Data Profiler Report Samples