The File Transfer Job is used to pick a file from the source and load it to the target server. The file type can be File or DFS. To create a File Transfer Job, you should first create the Data Points for source and target.

To create the File Transfer Job follow the below steps.

Step I: From the Jobs menu, drag and drop the File Transfer Job on canvas.

Step II: Provide the general details of Job

On Canvas, select the File Transfer Job, and then under Properties, provide the General details.

Name - The Name field displays the name of the job. To edit the Job name, click the arrow next to the name field.

Description - In the text box, you can provide a description and is optional.

Disable task - Check Disable task, if the job need not be executed as part of the Job Flow, and you do not want to delete the Job.

Step III: Optionally specify the retry attempts.

Under Properties, select the Properties tab to enable retry attempts for File Transfer job execution.

Retry EnabledCheck the retry option if you want to enable retry attempts for File Transfer job.

  • No. of Retry Attempts: Specify the number of attempts to retry File Transfer job execution if in case the job fails to execute. By default, the retry attempts is set to 2.
  • Retry Wait Time (in Seconds): Specify the duration in seconds for the job to retry next execution. By default, the duration is set to 60 seconds. If the Job fails to execute, it retries again for next execution attempt after the specified wait time. 

Step IV: Enter source connection details

1. Under Properties, click Source Options. To add the Source Data Point, that is the source file connection details, click Add.

2. The Window displays the list of file types, select the file type required and click OkFor this example, let's choose File.

3. You can choose either File, Amazon S3, Azure or GCS database type under File, DFS or Avro file type. Select the Data Point for file type chosen and click Ok

If there is any Global project that the user has access to, then the window displays the Project drop-down, which lists all the global projects. You can choose the global project from the Project drop-down, and select the global File , DFS or Avro file type data point as required.

4. Once you choose the file type, under Source Options, you can view and update the Data Point Property values as needed. To know more about File source property values, refer Editing File Properties.

Step V: Enter target connection details for File to be moved

1. Under Properties, click Target Options. To add the Target Data Point, that is the target connection details where the file needs to be moved, click Add.

2. The Window displays the list of file types, select the file type required and click OkFor this example, let's choose File.

3. You can choose either File, Amazon S3, Azure or GCS database type under File, or DFS file type. Select the Data Point for file type chosen and click Ok

If there is any Global project that the user has access to, then the window displays the Project drop-down, which lists all the global projects. You can choose the global project from the Project drop-down, and select the global File , DFS or Avro file type data point as required.

4. Once you choose the file type, under Target Options, you can view and update the Data Point Property values as needed. To know more about File target property values, refer Editing File Properties.

Note:

  • To save the Job Flow, on the Actions menu, click Save. For more information, refer Saving Job Flow
  • To revert the changes before saving the Job Flow, on the Actions menu, click Revert. For more information, refer, Reverting changes in Job Flow.
  • To execute individual job in the Job Flow, on the Actions menu, click Run Job. For more information, refer Executing individual Job in Job Flow.
  • To execute the Job Flow, on the Actions menu, click Run. For more information, refer Executing Job Flow.
  • Once the Job is created and the changes are saved, then, close or unlock the Job Flow so that it is editable by other users. For more information, refer Closing Job Flow and Unlocking Job Flow