Execute Talend job on server

Posted By : Amit Kumar Gupta | 11-Sep-2017

Today I am going introduce how to execute Talend job on the server. Firstly we should know about Talend tool. Talend is an ETL(Extraction, Transformation, and Loading) tool. Basically, What an ETL tool does it pull the data from the source, applied a desired/necessary transformations to it and then load the data into the specified target. Mainly ETL tool is required in a large amount of data manipulation for example when we connect two databases for two different applications and it is placed on two different application then we require the feature of ETL tool for extraction of data from the source and after manipulation on data load the data into the target. 

 

The steps required in ETL processes are as follows.

Step 1)The first step is to pull the data from the source database.
Step 2)Applied a desired/necessary transformation on the data(i.e. remove an unwanted field, validation on field etc).
Step 3)Then load the data into the target database.
Talend is open source project for data integration, data manipulation, Big data.

 

Procedure to create job

1)Open the Talend Studio.
2)Write click on Job Designs and click on Create Job.
3)A popup window will open and specify the name of the job and then click on finish button. Now job will create.

 

Procedure to export job 

1)Right click on the Job name. Select Build Job.
2)A popup window of build job is open. Browse the location where the job script is exported.Select the Autonomous job item from select build type drop-down. Finally, click on Finish button.
3)A zip will create on the selected location.

 

Executing the job on server

1)Copy the zip file from the source location and paste on a destination where you want to execute.
2)Extract the zip file from the destination.
3)Open the unzipped folder. Executable files(jobName_run.sh/jobName_run.bat) are placed here.
4)Now the execute the file on Linux server by this command "bash jobName.sh" or in windows by clicking the jobName_run.bat

About Author

Author Image
Amit Kumar Gupta

Amit is a bright Web App Developer, and has good knowledge of Java,Machine Learning, Python, Algorithm. His hobbies are playing badminton and reading novel.

Request for Proposal

Name is required

Comment is required

Sending message..