Delete Duplicates

Determine input identifier of edited object. It is possible to use Latin characters, numbers or the _ special character.

Set link to object. To do this, select the ETL task object in the drop-down list. Data from the object is sent to input.

Add required fields of the ETL task object to the list. Data will be loaded to specified fields.

NOTE. For the XML data consumer, the list of fields displays the XPath field that is identifier of the node in XML file. The field is created automatically and cannot be edited.

To add all fields from the object being consumer linked to the input to the list:

1. Click the Fill From button.

2. Select the From Consumer item in the button's drop-down menu.

To add all fields from the object being provider linked to the output to the list:

1. Click the Fill From button.

2. Select the From Provider item in the button's drop-down menu.

Click the Add button to add a new field. A dialog box opens where values of field attributes can be determined:

NOTE. The Field Properties dialog box appearance depends on the selected data provider.

Set field attributes in the dialog box:

• Identifier. Unique identifier of the field.

• Name. Field name.

• Data Type. Select type of field data in the drop-down list.

• Total Length. Determine total length of a field. It is available only for string and real type data.

• Decimal Places. Determine the number of decimal places. It is available only for real type data.

• Calculated Field. To set a formula, for which field value is calculated, select this checkbox. After selecting the checkbox enter the formula by using the keyboard or expression editor that opens on clicking the button.
  To increase the value of each new record for a fixed size, use the INCREMENT special expression.

NOTE. The INCREMENT special expression is available only for calculated field of integer type.

The syntax of the expression: INCREMENT[Value1, Value2] where Value1 - initial value, Value2 - step, by which the Value1 value must increase on each expression call. Each data loading starts with initial value.

To edit field:

• Double-click the field.

• Select the required field and click the Edit button.

To delete the selected field, click the Delete button. The field is deleted without confirmation of executing operation.

To move the field selected in the list, use the Up and Down buttons.

Determine output identifier of edited object. It is possible to use Latin characters, numbers or the "_" special character.

Determine a connection with the consumer object, to which data will be loaded. To do this, select the ETL task object in the drop-down list.

Fields of consumer object, to which data is to be loaded, are used to determine the format of data output.

NOTE. Editing the fields list is available only for data provider connectors. The fields list is filled in automatically for data consumer connectors.

To add all fields from a linked consumer object to the list:

1. Click the Fill From button.

2. Select the From Consumer item in the button's drop-down menu.

After executing the operations, all fields from the linked data consumer object will be added to the fields list.

To add all fields from a linked provider object to the list:

1. Click the Fill From button.

2. Select the From Provider item in the button's drop-down menu.

After executing the operations, all fields from the linked data provider object will be added to the fields list.

To add a new field:

1. Click the Add button. The Field Properties dialog box opens:

2. Set values of field attributes in the dialog box that opens:

• Identifier. Determine a field unique identifier. FIELD<Field number> is used by default.

• Name. Determine a field name. FIELD<Field number> is used by default.

• Type. Select type of field data in the drop-down list:

• String.

• Integer.

• Real.

• Data.

• Text.

The String data type is used by default.

• Calculated Field. To set a formula, by which field value is calculated, select this checkbox. After selecting the checkbox enter the formula by using the keyboard or expression editor that opens on clicking the Browse button.
  To increase the value of each new record for a fixed size, use the INCREMENT special expression.

NOTE. The INCREMENT special expression is available only for calculated field of integer type.

The syntax of the expression: INCREMENT[Value1, Value2] where Value1 - initial value, Value2 - step, by which the Value1 value must increase on each expression call. Each data loading starts with initial value.

3. Click the OK button.

After executing the operations, a new field is added.

To edit field:

• Double-click the field.

• Select the required field and click the Edit button.

After executing the operations, the given above Field Properties dialog box opens.

To delete the selected field, click the Delete button. The field is deleted without confirmation of executing operation.

To change data loading order to the connector, select the required field and move it in the list of fields using the Up and Down buttons.

Specify output identifier with error records. It is possible to use Latin characters, numbers or the _ special character.

Set up a connection with the consumer object, to which information about error records will be exported. To do this, select the ETL task object in the drop-down list.

Fields of consumer object, to which data is to be uploaded, are used to determine the format of data output. The list of fields is filled in automatically when setting up a link to the consumer object.

To determine advanced settings to be applied when there are error records, execute the following operations:

1. Click the Settings button. The dialog box with the same name opens:

2. Determine settings:

• Maximum Number of Errors in the Error Output. Specify the maximum number of error records, information about which is exported. The -1 value is set by default, in this case information about all error records is exported.

NOTE. If there is a number of error records, information export may slow down ETL task execution.

• Action Executed on Exceeding the Maximum Number of Error Records. Select the action in the drop-down list, which is executed if the maximum number of error records is exceeded:

• Stop Task Calculation. If the maximum number of error records is exceeded, task calculation is stopped.

• Stop Outputting Records. Default. If the maximum number of error records is exceeded, record output is stopped.

After executing the operations, the settings will be determined that will be applied when there are error records.