Skip to main content

SSIS_Some Important Settings in Data Flow Tasks & Transformations.

Topics :  (Flat File Source, Conditional Split, Character Map Transformation, Expression Task/Derived Column Transformation, Multicast Transformation, Raw File Source, Lookup Transformation)

 Flat File Source 


The data type can also be changed in the flat file editor(in Advance Mode) for each column in the Flat file.

Conditional Split 


We can have Matched and Unmatched rows based on a particular condition.

Different list of drivers in OLEDB Destination.



If you dont have the Drivers in the above list , then you have to download the drivers.( for ex. download DB2 drivers , Download Netezza drivers ) .

Table or view fast load :

In the OLEDB Destination .This option does , batching operation , which make the process faster.

Sample Example using Conditional Split Transformation



Character Map Transformation for UpperCase



Or use UPPER keyword in Conditional Split Transformation for uppercase in the selected columns.


Derived Column  Transformation ( Writing Expression for Concartination and addition of new column) 




Changing the Datatype in  Derived Column Transformation in Advance Editor.


We perform Trimming Operation to avoid mis-matched rows (using Derived Column Transformation ) 



Just Another Sample Example 



IMP : Excel File Destination has DTWSTR data where as the Flat File Data in DTSTR data. So we use the following Data Conversion Tranformation in middle.






Using Multicast to keep one copy of data to different destinations.

Raw File Source to SQL Server Destination 



LookUp Transformation




Error Handling :




 1. Fail Component ( Default setting in SSIS )
      Once Error is occurred the data flow execution is stopped.
 
 2.Ignore Failure 
    Data Flow execution is continued with next steps, by ignoring the errors.

 3. Redirect Rows( Using Red Pipeline ) 
    It Redirects the Mismatched rows to some other destination and the Data flow execution is continued.

Ex.
Fuzzy lookup:
This Transformation doesnt correct the data, it only identifies the close matches.


In the below example Fuzzy lookup added 3 more columns and then the following output was given.

After Identifying you can update the data in such manner in SQL.