Websphere validating links

These streamlined versions of warehouse tables are used to perform data validation (lookups) within an ETL job and select specific data from lookup tables (such as source ID fields in dimensions).

In the validation (lookup) process the smaller hash file is accessed, rather than the base warehouse table, improving performance.

I'm a little late to this, but I just found a great introduction if you are looking for a guide to using Java APM from the folks at

Source to OWS jobs assign a source system ID (SRC_SYS_ID) for the transaction system from which you are extracting data and populate the target OWS tables with that ID.

Jobs in this category extract data from your transaction system and populate target dimension and fact tables in the MDW layer of the warehouse.

ETL Jobs are a collection of linked stages, data elements, and transformations that define how to extract, transform, and load data into a target database.

Stages are used to transform or aggregate data, and lookup information.

OWS to OWE jobs perform lookup validations for the target OWE tables to ensure there are no information gaps and maintain referential integrity.

Many of the jobs aggregate your transaction data for the target F00 tables.

Jobs in this category extract data from the OWS tables and populate target DIM and FACT tables in the MDW layer of the warehouse.

OWS to MDW jobs generate a surrogate key that helps facilitate dimension key resolution.

A job is a collection of linked stages, data elements, and transforms that define how to extract, cleanse, transform, integrate, and load data into a target database. The IBM Web Sphere Data Stage client enables you to administer projects, edit repository contents, and create, edit, schedule, run, and monitor ETL jobs.

Three components comprise the Data Stage client: IBM Web Sphere Data Stage contains many different components that support the ETL process.

As part of your installation and configuration process you import the *file into a project that has been defined in your development environment.

Tags: , ,