Senior Data Engineer

Technology:  Talend Big Data Integration (6.3 & 7.1Enterprise Edition), Talend Cloud Integration, Azure Cloud Storage, Snowflake, Azure DevOps, Talend CI/CD Pipelines, Linux, Python, GIT

Primary Responsibilities:

• Involved in complete development of Talend Code lifecycle from Development, Unit Test, Integration Test, Deployment and Code maintenance.
• Have Designed and Developed the Talend jobs using Talend Data Integration Platform
• Involved in developing in Unit Testcase using Talend in built Test Case Components for each Talend jobs.
• Standardized the process of CI/CD using Azure DevOps pipeline and Talend CI/CD.
• Have extensively used Snowflake Cloud Data Warehouse to build DataMart.
• Used the Talend-Snowflake components like tSnowflakeInput, tSnowflakeOutput, tSnowflakeBulkExec, tSnowflakeOutputBulk, tSnowflakeOutputBulkExec and tSnowflakeRow.
• Have Integrated the Salesforce system with Snowflake using the Talend Salesforce Components to load Customer data.
• Worked on Talend Best practices – Joblets, Context Variables, Parent and Sub jobs to achieve code reusability.
• Achieved maximum Test Coverage for the Talend jobs using Talend Test Cases.
• Standardized the process of Talend Code deployment from Dev to UAT and Production through Azure Pipelines and release cycles.
• Involved in Design reviews and Peer reviews of Talend Code.
• Interacted with multiple Stakeholders to get the Project requirement.
• Extensively interacted with end users like Data Scientist and Reporting team and provided the data as per the requirement.
• Involved in building code for monitoring and housekeeping activities like logging, alerting and Error Handling.