ETL Developer

Company Overview

Company details are not specified.

Job Summary

The ETL Developer will be responsible for designing and implementing data migration solutions focusing on transitioning from Oracle Cloud to on-premises MySQL databases. This role is crucial for ensuring data integrity and consistency throughout the migration process and involves the use of various ETL tools and techniques.

Responsibilities

• Develop and execute SQL scripts and Python migration scripts to facilitate the data transition from Oracle Cloud to MySQL databases.
• Utilize ETL libraries and perform data transformations, ensuring accurate ID mapping, data cleansing, and management of lookup table joins.
• Implement exception handling, logging frameworks, scheduling, and monitoring using cron, Apache Airflow, or custom scripts.
• Conduct thorough testing of data transformations to ensure quality and accuracy prior to migration.
• Maintain comprehensive documentation of ETL logic, transformation rules, and exception cases for future reference and audits.
• Analyze and optimize performance associated with large data files, incremental updates, and historical data loads.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• 5 to 6 years of overall experience in data engineering or ETL development with 2 to 3 years of relevant experience focused on ETL processes.
• Strong knowledge of Python 3.x for data manipulation and automation tasks.
• Proficient in ETL libraries such as pandas, SQLAlchemy, cx_Oracle, pymysql, pyodbc, or mysql-connector-python.
• Strong SQL skills, particularly in Oracle PL/SQL and MySQL.
• Experience in data types, normalization/denormalization, indexing, and relational data integrity.
• Familiarity with stored procedures, triggers, and constraints within databases.

Preferred Skills

• Experience with scheduling and monitoring tools such as Apache Airflow.
• Understanding of data transformation best practices, particularly related to large datasets.
• Familiarity with Linux operating systems and on-premises database solutions.

Experience

• A minimum of 5 years of overall professional experience, with at least 2 to 3 years specifically in ETL development.

Environment

• The position requires a mandatory work from office (WFO) setup, Monday to Friday, located in Sector 98, Noida.
• Commitment to operating in a structured, on-premises environment facilitating connections with multiple data sources.

Salary

Salary details are not specified.

Growth Opportunities

Opportunities for career advancement are not specified.

Benefits

Benefits offered are not specified.