ETL Developer_WC | Codersbrain
Job Description
ET Developer_Wc
Company Overview
The company overview is not specified.
Job Summary
The Data Engineer is responsible for designing, developing, and maintaining robust ETL processes that efficiently extract, transform, and load data from various sources. This role is crucial for ensuring data quality and consistency, as well as supporting the organization's data needs through collaboration across teams.
Responsibilities
- Design, develop, and maintain robust ETL processes for efficient data extraction, transformation, and loading.
- Write and optimize complex PL/SQL queries and stored procedures in PostgreSQL or Oracle.
- Collaborate with business analysts and data architects to understand and translate data requirements into technical specifications.
- Ensure data quality, integrity, and consistency across different systems and environments.
- Develop and manage continuous integration and continuous deployment (CI/CD) pipelines for automated testing, deployment, and integration of ETL jobs.
- Monitor and troubleshoot ETL jobs and data-related issues while providing root cause analysis and resolution.
- Participate in code reviews, performance tuning, and the creation of technical documentation.
Qualifications
- Strong hands-on experience with PostgreSQL or Oracle databases.
- Proficiency in PL/SQL, including experience writing stored procedures, triggers, functions, and packages.
- Experience in building and maintaining ETL pipelines using tools like Apache NiFi, Informatica, Talend, or custom scripting solutions.
- Familiarity with CI/CD tools such as Jenkins, Git, Bitbucket, or Azure DevOps.
- Experience with version control systems and deployment automation practices.
- Good understanding of data modeling, data warehousing concepts, and performance tuning.
- Knowledge of Unix/Linux scripting is a plus.
- Bachelor's degree in Computer Science, Engineering, or a related field is preferred.
Preferred Skills
- Exposure to cloud platforms like AWS, Google Cloud Platform (GCP), or Microsoft Azure is an added advantage.
- Experience working in Agile/Scrum environments.
Experience
Details regarding minimum years of experience required for the role are not specified.
Environment
The typical work setting details and location specifics (remote, in-office, hybrid) are not specified.
Salary
Salary information is not specified.
Growth Opportunities
Details regarding potential career advancement opportunities within the company are not specified.
Benefits
Information regarding offered benefits, such as insurance, paid leave, or work policies, is not specified.