IEtlTask.PartialFetch

Syntax

PartialFetch: Boolean;

Description

The PartialFetch property determines whether ETL task uses batch data processing.

Comments

Available values:

True. Batch data processing is used.
False. Batch data processing is not used.

By default, data from sources is calculated in the whole that requires much memory and is often not allowed. To speed up data read process, use this property. To set the number of processed records, use IEtlTask.DefaultBlockSize or IEtlPlainDataProvider.FetchBlockSize.

Batch data processing will not be used if a procedure, or procedure based on template, Delete Duplicates, Sort, or Join transformers are added in ETL task.

Example

Executing the example requires that the repository contains an ETL task with the T_ETL identifier.

Add links to the Etl, Metabase system assemblies.

Sub UserProc;
Var
    MB: IMetabase;
    MObj: IMetabaseObject;
    EtlTask: IEtlTask;
Begin
    MB := MetabaseClass.Active;
    MObj := MB.ItemById("T_ETL").Edit;
    EtlTask := MObj As IEtlTask;
    EtlTask.PartialFetch := True;
    EtlTask.DefaultBlockSize := 300;
    MObj.Save;
End Sub UserProc;

After executing the example, batch data processing is enabled in ETL task, and batch size is set.