ETL Talend Developer | Codersbrain
full-time
Posted on May 13, 2025
Job Description
Responsibilities
- Design, develop, and implement ETL solutions using Talend Data Integration tools
- Extract data from various sources, transform it according to business rules, and load it into target systems (ETL)
- Collaborate with data analysts, architects, and stakeholders to understand data requirements
- Optimize ETL workflows for performance, scalability, and maintainability
- Perform data validation, error handling, and logging for ETL jobs
- Monitor and troubleshoot ETL processes and resolve data quality issues
- Maintain data documentation, metadata, and job schedules
- Ensure compliance with data governance, security, and privacy standards
Required Skills & Qualifications
- 3+ years of experience in ETL development with Talend (Open Studio or Enterprise Edition)
- Strong experience with SQL and relational databases (e.g., MySQL, SQL Server, Oracle)
- Familiarity with data integration patterns, data warehousing, and data modelling
- Experience with job scheduling and automation tools
- Solid understanding of data quality frameworks and best practices
- Ability to write clean, efficient, and reusable ETL code
- Strong analytical and problem-solving skills
- Excellent verbal and written communication skills
- Experience with cloud-based data platforms
- Knowledge of REST/SOAP APIs and working with flat files, XML, JSON, etc.
- Experience with Git or other version control systems
- Understanding of Agile/Scrum methodologies
- Design and implement Talend jobs to read from the ActiveMQ opt-in/out queue and load data into Azure SQL Server.
- Translate business logic from Java services into ETL workflows (e.g., timestamp checks, deduplication).
- Build daily or near-real-time ETL processes for:
- Profile changes
- Loyalty summary Data
- Store Date
- Ensure data integrity, error handling, and retry mechanisms are in place (especially during Talend outages or queue buildup).
- Implement monitoring and alerting for ETL failures or queue delays.
- Support initial data migration pipeline from Oracle Berkeley DB to SQL Server.
- Collaborate with SQL team for staging layer design and final table mappings.
- Coordinate with SFTP team for generating and transferring campaign files to Marketing team