Load step under Query Object loads the incoming data (after extraction and transformation) into a target system (File, Relational database, HDFS, No SQL / Columnar system etc.).
You need to select a target Intellicus connection (already created under Configure > Databases) on which data should be loaded. One of the important configurations is the deselecting of the ‘Read Only’ setting of the target system. If not de-selected, this will not show in the list of target system where the extracted data can be loaded.
There are target connection specific properties required to load data into the system.
You can fetch list of existing Tables/Files from the connection.
Figure 19: Load Step
The properties of Load step (in case target system is an RDBMS) are:
|Target Connection||Select from list||Select a target connection on which data should be loaded|
|Target Table Name||Select from list||Select target table name using the selected Target Connection|
|If Table Exists||Select from list:
Delete Existing Data
Drop and Create New Table
Truncate Existing Data
|Action to be performed in case table exists:
To append data in the end
To delete data in existing table
To not perform any action on table and skip load step
To drop the table and create new table with same name and new schema.
To delete data in existing table, but Admin user can roll back this data
|Suffix TimeStamp||Check/Uncheck||Check= suffix timestamp in the chosen format to table
Select from the available list
|Data Properties||If Record Exists||Select from list:
Update or Insert
|Action to be performed in case record exists:
Insert the new record
Update the existing record with the new
In case of an existing record, update it with the new record
Else insert the new record
|Ignore Empty Rows||Check/Uncheck||Check= ignores empty rows in table while loading|
|Error Handling||Error Threshold||Type Yourself||Specify count of error after which loading process should stop.
Any positive number>0 means stop processing after that many +1 errors i.e. if its value is 2, stop processing upon 3rd error.
|Column Properties||Fetch Schema||Click the option||Fetches schema of the existing table
You can see the field details of the data to be loaded under Column Properties section
|Remove All Columns||Click the option||Removes all columns in the target table|
You can run and schedule Query Objects which are of Load type from under Explorer.
Load step can also be followed by the Data Source step further followed by Format step to be used for generating reports.
Note: To know about loading into file, HDFS, NoSQL (Columnar) system, refer to WorkingwithLoadStep document.