Data Analyst II

The Data Analyst (DA) is responsible for leading the data integration efforts. Responsibilities for this role include source data and model analysis, data entry of physical mappings into the InformEnt Warehouse ETL tool, processing files, developing the Functional Specifications documentation, unit testing of mappings, rules, and postloads.  

Data integration is defined as incorporating source applications into target destinations in the data warehouse.  This process transforms data from source operational systems into meaningful business information. The Business Requirements List (BRL), which is the agreed upon scope and deliverable between the client and InformEnt, drives this process.  After the BRL has been defined, the data is divided into manageable EnterMartsTM for a ?phased in? approach.  An EnterMart? can be described as a target set of files/fields selected for integration based on the documented requirements outlined in the BRL.

It is the analyst?s goal to normalize and standardize the source data into the warehouse.  Normalization ensures that all attributes are allocated to their correct Entity Type without redundancy in the model.  Standardization ensures the grouping of names and values of similar data elements.  The analyst assists the Project Manager in the development of the BRL and works closely with the Database Programmer (DBP) to achieve the mutual goal of a successful implementation. They also assist the Knowledge Consultant, if applicable, with development of reports, views, and imports/exports that may comprise acceptance criteria.

The data integration process is comprised of three main phases and numerous sub phases. The three main phases are defined as:

Data Discovery/Data Modeling
Discovery sessions are conducted so that the analyst can collect information about a client?s source systems and files and understand detailed information about the source fields. This is an ongoing process, which is performed through all stages of the project. File layouts and/or copybooks are reviewed with the client to help understand the key structure of the source application and the databases contained within.

Data Definition
During Data Definition phase, the Data Analyst defines all meta data for the source files defined by using the Warehouse Architect GUI.  Warehouse Architect is an InformEnt automation tool used to define new source and destination entities, maintain existing source and destination entities, map the source to the target destination, and create mapping rule logic as required.


Data Validation  
Data validation is comprised of a combination of three types of testing by the Data Analyst; unit testing, postload testing and integration testing.  Unit testing is performed to validate a ?unit? or single source application file loaded to the warehouse independently.  Postload testing is performed to validate data that has been transformed after loads have been completed and integration testing is performed to validate consistencies in data loaded between tables.


Experience:
Meeting with clients to detail requirements
Analyzing source data files/tables
Defining integration and transformations between source data and target warehouse/database implementing/coding integration and transformation logic-via Informatica, DataStage or similar ETL tools
Recommending and requesting data model/database enhancements
Testing data integration

Skills/Tools:
Solid understanding of relational data
data analysis
SQL
Oracle (preferred)
Informatica, DataStage (or other ETL tools)
Data Modeling