Google Publisher is used in Job Flow to rely on staging location for your event data on its journey towards processing, storage, and analysis.

Note:  To create a new Job Flow, refer Creating New Job Flow

To create the Google Publisher Job follow the below steps. 

Step I: From the Jobs menu, drag and drop the Google Publisher on canvas.

Step II: Provide the General details of Job.

On Canvas, select the Google Publisher Job, and then under Properties, provide the General details.

Name - The Name field consists of default name and is editable.

Description - In the text box, you can provide a description and is optional.

User Information - Displays the information about the user who last updated the job along with date and time of last save.

Disable task - Check Disable task, if the job need not be executed as part of the Job Flow, and you do not want to delete the Job.

Step III: Optionally specify the retry attempts.

Under Properties, select the Properties tab to enable retry attempts for Google Publisher job execution.

Retry EnabledCheck the retry option if you want to enable retry attempts for Google Publisher job.

  • No. of Retry Attempts: Specify the number of attempts to retry File Transfer job execution if in case the job fails to execute. By default, the retry attempts is set to 2.
  • Retry Wait Time (in Seconds): Specify the duration in seconds for the job to retry next execution. By default, the duration is set to 60 seconds. If the Job fails to execute, it retries again for next execution attempt after the specified wait time. 

Step IV: Enter source connection details

1. Under Properties, click Source Options. To add the Source Data Point, that is the source file connection details, click Add.

2. The Window displays the list of file Data Points. You can choose File Data Point.

If there is any Global project that the user has access to, then the window displays the Project drop-down, which lists all the global projects. You can choose the global project from the Project drop-down, and select the global File data point as required.

3. Under Source Options, the source Data Point Property values are set to default values. Based on your requirement, you can change the property values.

Note:

  • To change the Source File Data Point, click Change
  • To change the default values, click on the respective field and change the value, and to revert, click the Reset icon. The Reset icon appears only when the property value is changed.

4. Provide the following details in the Source Data Point Properties.

PropertyDescriptionDefault ValueOther possible values

Message Generation Options

Choose message generation option from which data is read to subscriber.

Publish From Files Content: Send data from files as message to subscriber.

Publish Message From Command: Send data using commands as message to subscriber.

Publish Message From Command

Message Read Option (Displays only when Message Generation Options is "Publish From Files Content")

Each File As a Message:

Each Line As a Message:



File Location(Displays only when Message Generation Options is "Publish From Files Content")

Specify location of the input file.

$$SrcFileDir


File Name(Displays only when Message Generation Options is "Publish From Files Content")

Specify input file name to read.

instNm


File Data Reference(Displays only when Message Generation Options is "Publish From Files Content")

You can pick the type of file needed from source in three ways -

Direct: Pick the single file that matches the file name in source name.

Indirect: Pick the file names from file specified in source name.

Wildcard: Pick the files matching the pattern specified in the source name.

Direct

Indirect

Wildcard

Encode to Base 64


No

Yes

Serialize messages as protobuf


No

Yes

Publish Message From Command(Displays only when Message Generation Options is "Publish Message From Command")




Step V: Enter target connection details for File to be moved

1. Under Properties, click Target Options. To add the Target Data Point, that is the target connection details where the file needs to be moved, click Add.

2. The Window displays the list of Data Points. You can choose the Google Publisher Data Point. 

If there is any Global project that the user has access to, then the window displays the Project drop-down, which lists all the global projects. You can choose the global project from the Project drop-down, and select the global data point as required.

3. Under Target Options, the target Data Point Property values are set to default values. Based on your requirement, you can change the property values.

Note: 

  • To change the Target File Data Point, click Change
  • To change the default values, click on the respective field and change the value, and to revert, click the Reset icon. The Reset icon appears only when the property value is changed.

The Target Data Point Property values are as shown in the table below.

PropertyDescriptionDefault ValueOther possible values
Topic NameTo specify target topic name where data needs to be loadeddiyotta

When the target is GCS data point then, the file transfer job provides additional option to add properties which will be uploaded with the file as metadata.