ETL开发指南

录..........................................................I

1. 引言............................................................1
1.1 编写目的.....................................................1
1.2 帮助使用......................................................1

2. 产品概述.........................................................1

3. 常规应用........................................................3
3.1 常用组件使用方法........................................3
3.1.1 Sequential file.............................................3
3.1.2 Annotation..................................................5
3.1.3 Change Capture Stage................................7
3.1.4 Copy Stage..................................................9
3.1.5 Filter Stage...................................................10
3.1.6 Funnel Stage.................................................11
3.1.7 Tansformer Stage..........................................12
3.1.8 Sort Stage......................................................13
3.1.9 LookUp Stage.................................................14
3.1.10 Join Stage.......................................................14
3.1.11 LookUp Stage  和 Join Stage的区别...................15
3.1.12 Merge Stage....................................................16
3.1.13 Modify Stage....................................................17
3.1.14 Data Set Stage.................................................18
3.1.15 File Set Stage....................................................20
3.1.16 Lookup File Set Stage..........................................21
3.1.17 Oracle Enterprise Stage.....................................24
3.1.18 Aggregator Stage...............................................26
3.1.19 Remove Duplicates Stage....................................28
3.1.20 Compress Stage..................................................29
3.1.21 Expand Stage.......................................................30
3.1.22 Difference Stage......................................................31
3.1.23 Compare Stage...................................................34
3.1.24 Switch Stage...........................................................35
3.1.25 Column Import Stage.................................................37
3.1.26 Column Export Stage...................................................39
3.2 常用数据库的连接..............................................................41
3.2.1 Oracle数据库连接..............................................................41

4. 高级应用..................................................................................43
4.1 DATASTAGE BASIC接口.........................................................43
4.2 自定义STAGE TYPE .................................................................43
4.2.1 Wrapped Stage...................................................................43
4.2.2 Build Stage.........................................................................43
4.2.3 Custom Stage........................................................................43
4.3 性能调优...............................................................................43
4.3.1 优化策略................................................................................44

5. 开发经验技巧汇总..............................................................46
5.1.1 问题................................................................46