Info

rmatica

Tra

inin

g

INFORMATICAINFORMATICA

Performance Tuning

Performance Tuning

Business Information GroupBusiness Information Group

Info

rmatica

Tra

inin

g

Informatica TuningInformatica Tuning

ObjectiveObjective

To optimize the Informatica mapping To optimize the Informatica mapping to execute fasterto execute faster

To optimize session performance by To optimize session performance by eliminating performance bottlenecks.eliminating performance bottlenecks.

To satisfy the customer to give the To satisfy the customer to give the result in expected timeresult in expected time

Info

rmatica

Tra

inin

g

Identifying the performance Identifying the performance bottlenecksbottlenecks

Optimizing the Target DatabaseOptimizing the Target Database

Optimizing the Source DatabaseOptimizing the Source Database

Optimizing the MappingOptimizing the Mapping

Optimizing the SessionOptimizing the Session

Optimizing the systemOptimizing the system

PartitioningPartitioning

Info

rmatica

Tra

inin

g

Identify Target BottlenecksIdentify Target Bottlenecks

Identify the target typeIdentify the target type

If the target is database, configure the If the target is database, configure the session to write to a flat file and session to write to a flat file and measure the performancemeasure the performance

If the target is already a flat file, they If the target is already a flat file, they you may not have target bottlenecksyou may not have target bottlenecks

Info

rmatica

Tra

inin

g

Identify Source BottlenecksIdentify Source Bottlenecks

Using a Filter TransformationUsing a Filter Transformation

Using a Read Test SessionUsing a Read Test Session

Using a Database QueryUsing a Database Query

Info

rmatica

Tra

inin

g

Identifying Mapping Bottlenecks

Identifying Mapping Bottlenecks

High Rowsinlookupcache countersHigh Rowsinlookupcache counters

High Errorrows countersHigh Errorrows counters

Info

rmatica

Tra

inin

g

Identifying a Session Bottlenecks

Identifying a Session Bottlenecks

Aggregator, Rank and Joiner Aggregator, Rank and Joiner Readfromdisk and Writetodisk countersReadfromdisk and Writetodisk counters

Source and Target BufferInput_efficiency Source and Target BufferInput_efficiency and buffer output_effeciency countersand buffer output_effeciency counters

Info

rmatica

Tra

inin

g

Identifying system bottlenecks

Identifying system bottlenecks

Identify system bottlenecks by using system tools Identify system bottlenecks by using system tools to monitor CPU usage, memory usage and paging.to monitor CPU usage, memory usage and paging.

In windows NT/2000, use Performance tab in Task In windows NT/2000, use Performance tab in Task managermanager

In Unix, use vmstat and iostat to monitor system In Unix, use vmstat and iostat to monitor system performanceperformance

Info

rmatica

Tra

inin

g

Optimizing the Target Database

Optimizing the Target Database

Drop indexes and key constraintsDrop indexes and key constraints

Increase checkpoint intervalsIncrease checkpoint intervals

use bulk loadinguse bulk loading

use external loadinguse external loading

Turn off recoveryTurn off recovery

Increase database network packet sizeIncrease database network packet size

optimize Oracle target databaseoptimize Oracle target database

Info

rmatica

Tra

inin

g

Optimizing Oracle Target database

Optimizing Oracle Target database

Make sure that tables are using large Initial and next Make sure that tables are using large Initial and next valuesvalues

Store table and index data in separate table space, Store table and index data in separate table space, preferably on different diskspreferably on different disks

Make sure that the database stores rollback segments Make sure that the database stores rollback segments in appropriate tablespaces.in appropriate tablespaces.

Tune the Oracle redo logTune the Oracle redo log

Info

rmatica

Tra

inin

g

Optimize the source flat fileOptimize the source flat file

Change the bytes per line as per the Change the bytes per line as per the source structuresource structure

Set the Line sequential Buffer Length Set the Line sequential Buffer Length setting in the session propertiessetting in the session properties

Info

rmatica

Tra

inin

g

Optimizing the source DBOptimizing the source DB

Optimize the queryOptimize the query

Create tempdb as in-memory databaseCreate tempdb as in-memory database

use conditional filtersuse conditional filters

Increase database network packet sizeIncrease database network packet size

Connect to Oracle databases using IPC protocol.Connect to Oracle databases using IPC protocol.

Info

rmatica

Tra

inin

g

Optimizing the MappingOptimizing the Mapping

Configure single-pass readingConfigure single-pass reading

Optimize datatype conversionsOptimize datatype conversions

Eliminate transformation errorsEliminate transformation errors

Optimze transformationsOptimze transformations

Optimize expressionsOptimize expressions

Info

rmatica

Tra

inin

g

Optimizing Lookup TransOptimizing Lookup Trans

Caching LookupCaching Lookup

Reduce the number of Number of Reduce the number of Number of cached rowscached rows

Indexing Indexing

Info

rmatica

Tra

inin

g

Optimizing FILTER transOptimizing FILTER trans

Filtering early in the flowFiltering early in the flow

Move the filter into source qualifierMove the filter into source qualifier

avoid using complex exressionsavoid using complex exressions

Info

rmatica

Tra

inin

g

Optimizing Aggregator Trans

Optimizing Aggregator Trans

Group by simple colsGroup by simple cols

Use sorted inputUse sorted input

Use incremental aggregationUse incremental aggregation

Info

rmatica

Tra

inin

g

Other Trans optimizationOther Trans optimization

Joiner TransformationsJoiner Transformations

Sequence GenaratorSequence Genarator

Info

rmatica

Tra

inin

g

Optimizing ExpressionsOptimizing Expressions Factoring out common logicFactoring out common logic

Minimizing aggregate function callsMinimizing aggregate function calls

Replacing common sub-expressions with Local variablesReplacing common sub-expressions with Local variables

Choosing Numeric versus string comparisionChoosing Numeric versus string comparision

Char-char and char-varcharChar-char and char-varchar

Decode versus LookupDecode versus Lookup

Info

rmatica

Tra

inin

g

Optimizing IIF ExpressionsOptimizing IIF Expressions

Evaluate expressionEvaluate expression

Info

rmatica

Tra

inin

g

Info

rmatica

Tra

inin

g

Optimizing the sessionOptimizing the session

Run concurrent batchesRun concurrent batches

Partition sessionsPartition sessions

Reduce errors tracingReduce errors tracing

Remove staging areasRemove staging areas

Tune session parametersTune session parameters

Info

rmatica

Tra

inin

g

Optimizing systemOptimizing system

Improving Network speedImproving Network speed

Reducing PagingReducing Paging

Info

rmatica

Tra

inin

g

PartitioningPartitioning

Optimizing the source Database Optimizing the source Database

Optimizing the Target Database for Optimizing the Target Database for partitioningpartitioning

Info

rmatica

Tra

inin

g

Creating Performance Details

Creating Performance Details

Enable MonitoringEnable Monitoring

Viewing Session Performance detailsViewing Session Performance details

Understanding Performance countersUnderstanding Performance counters

Info

rmatica

Tra

inin

g

New Features & Enhancements 5.1New Features & Enhancements 5.1New Features & Enhancements 5.1New Features & Enhancements 5.1

Performance EnhancementsPerformance Enhancements High precision decimal arithmeticHigh precision decimal arithmetic To_decimal and Aggregate functionsTo_decimal and Aggregate functions Cache ManagementCache Management Partition sessions with sorted aggregationPartition sessions with sorted aggregation

Info

rmatica

Tra

inin

g

Designer FeaturesDesigner Features

Debug mappletsDebug mapplets

Support for / in table and field namesSupport for / in table and field names

Info

rmatica

Tra

inin

g

Server featuresServer features

Continuous sessionsContinuous sessions

Info

rmatica

Tra

inin

g

Version 5.0Version 5.0 DebuggerDebugger

Double click folder icon to open the folder and toolDouble click folder icon to open the folder and tool

Find in Workspace toolFind in Workspace tool

Full screen viewFull screen view

Invalid mapping iconInvalid mapping icon

Lookup cacheLookup cache

Mapping parameters and variablesMapping parameters and variables

New Designer shortcut keys New Designer shortcut keys

New workspace lookNew workspace look

Object Import and exportObject Import and export

Preview dataPreview data

Info

rmatica

Tra

inin

g

Reimporting the source-target, retain relationshipReimporting the source-target, retain relationship

Resizable Expression EditorResizable Expression Editor

RouterRouter

save mapping and mapplets under a different namesave mapping and mapplets under a different name

XML source & targetsXML source & targets

Expanded pmcmd capabilityExpanded pmcmd capability

In Repository ManagerIn Repository Manager Compare foldersCompare folders Copy and replace folder Copy and replace folder Display user privileagesDisplay user privileages pmreppmrep

Info

rmatica

Tra

inin

g

Server Manager 5.0Server Manager 5.0 Additional email VariablesAdditional email Variables

Additional server variablesAdditional server variables

copy sessioncopy session

Global validation of sessionGlobal validation of session

Read only priv for sessionsRead only priv for sessions

Transformation Language EnhancementsTransformation Language Enhancements SESSSTARTTIMESESSSTARTTIME $$$SessStartTime$$$SessStartTime SetCountVariableSetCountVariable SetMaxVariableSetMaxVariable SetMinVariableSetMinVariable SetVariableSetVariable