Slow Running ETL process (read side) & Table Statistics (Oracle).

Sometimes an ETL process runs considerably slow speed. During test for the small result set it might fly but when a million rows are applied the performance takes a nosedive. There can be many reasons for slow ETL process.  The process can be slow because read, transformation, load. Lets eliminate the transformation and load for the sake of discussion. For ETL process to be slow on read side here are some reasons .1. No indexes on joins and/or ‘where clause’ 2. Query badly written. 3. Source not analyzed.  Out of...

Informatica Product Line

Informatica is a powerful ETL tool from Informatica Corporation, a leading provider of enterprise data integration software and ETL softwares. The important products provided by Informatica Corporation is provided below:     Power Center     Power Mart     Power Exchange     Power Center Connect     Power Channel     Metadata Exchange     Power Analyzer     Super Glue     Power Center & Power Mart: Power Mart is a departmental version of Informatica for building, deploying, and managing...

Informatica Software Architecture illustrated

Informatica ETL product, known as Informatica Power Center consists of 3 main components. 1. Informatica PowerCenter Client Tools: These are the development tools installed at developer end. These tools enable a developer to Define transformation process, known as mapping. (Designer) Define run-time properties for a mapping, known as sessions (Workflow Manager) Monitor execution of sessions (Workflow Monitor) Manage repository, useful for administrators (Repository Manager) Report Metadata (Metadata Reporter) 2. Informatica PowerCenter...

Informatica PowerCenter Components

Informatica PowerCenter is not just a tool but an end-to-end data processing and data integration environment. It facilitates organizations to collect, centrally process and redistribute data. It can be used just to integrate two different systems like SAP and MQ Series or to load data warehouses or Operational Data Stores (ODS). Now Informatica PowerCenter also includes many add-on tools to report the data being processed, business rules applied and quality of data before and after processing. To facilitate this PowerCenter is...

Informatica Transformations

Normalizer Transformation Active & Connected. The Normalizer transformation processes multiple-occurring columns or multiple-occurring groups of columns in each source row and returns a row for each instance of the multiple-occurring data. It is used mainly with COBOL sources where most of the time data is stored in de-normalized format. You can create following Normalizer transformation: *VSAM Normalizer transformation. A non-reusable transformation that is a Source Qualifier transformation for a COBOL source. VSAM stands for Virtual Storage Access Method, a file access method for IBM mainframe. *Pipeline Normalizer...

Sigmaways Inc

Who we are: Sigmaways is a high end consulting and business-driven IT training establishment founded by a team of veterans who are passionate about sharing the wisdom of knowledge. Our team has extensive experience in design, implementation and management of enterprise systems and technical training for more than twenty years. Our Instructors are the finest in the industry, having prior work experience from management consulting firm to Fortune 500 to Startups. We prepare individuals to lead and lead with skills. We mentor and train individuals to become the very best in their field of study by providing practical guidance...

8 Understanding Performance and Advanced ETL Concepts

This chapter includes the following topics: Best Practices for Designing PL/SQL Mappings Best Practices for Designing SQL*Loader Mappings Improved Performance Through Partition Exchange Loading High Performance Data Extraction from Remote Sources Best Practices for Designing PL/SQL MappingsThis section addresses PL/SQL mapping design and includes: Set Based Versus Row Based Operating Modes About Committing Data in Warehouse Builder Committing Data Based on Mapping Design Committing Data Independently of Mapping Design ...