Intellicus Enterprise Reporting and Business Insights 19.0

Load Step

0 views June 28, 2020 0

Load step under Query Object loads the incoming data (after extraction and transformation) into a target system (File, Relational database, HDFS, No SQL / Columnar system etc.).

You need to select a target Intellicus connection (already created under Configure > Databases) on which data should be loaded. One of the important configurations is the deselecting of the ‘Read Only’ setting of the target system. If not de-selected, this will not show in the list of target system where the extracted data can be loaded.

There are target connection specific properties required to load data into the system.

You can fetch list of existing Tables/Files from the connection.


Figure 19: Load Step

The properties of Load step (in case target system is an RDBMS) are:

Property Values Comments
Target Connection Select from list Select a target connection on which data should be loaded
Table Properties

 

 

 

 

 

 

 

Target Table Name Select from list Select target table name using the selected Target Connection
If Table Exists Select from list:

 

Append Data

 

Delete Existing Data

 

Skip Load

 

 

Drop and Create New Table

 

Truncate Existing Data

Action to be performed in case table exists:

 

To append data in the end

 

To delete data in existing table

 

 

To not perform any action on table and skip load step

 

To drop the table and create new table with same name and new schema.

 

To delete data in existing table, but Admin user can roll back this data

Suffix TimeStamp Check/Uncheck Check= suffix timestamp in the chosen format to table

 

Select from the available list

Data Properties If Record Exists Select from list:

 

Insert Only

 

Update Only

 

 

Update or Insert

Action to be performed in case record exists:

 

Insert the new record

 

Update the existing record with the new

 

In case of an existing record, update it with the new record

Else insert the new record

Ignore Empty Rows Check/Uncheck Check= ignores empty rows in table while loading
Error Handling Error Threshold Type Yourself Specify count of error after which loading process should stop.

Any positive number>0 means stop processing after that many +1 errors i.e. if its value is 2, stop processing upon 3rd error.

Column Properties Fetch Schema Click the option Fetches schema of the existing table

You can see the field details of the data to be loaded under Column Properties section

Remove All Columns Click the option Removes all columns in the target table

You can run and schedule Query Objects which are of Load type from under Explorer.

Load step can also be followed by the Data Source step further followed by Format step to be used for generating reports.

Note: To know about loading into file, HDFS, NoSQL (Columnar) system, refer to WorkingwithLoadStep document.