Data Engineer

Company Overview

Company information is not specified.

Job Summary

As a Data Engineer, you will be responsible for building, maintaining, and optimizing scalable data pipelines. Your work will support enterprise data ingestion, ETL workflows, and cloud data warehousing for large-scale datasets using AWS Data Technologies, including Redshift, Snowflake, and DBT.

Responsibilities

• Develop and maintain data ingestion processes from PostgreSQL source systems to the Enterprise Data Platform (Snowflake and Redshift).
• Implement ETL pipelines using DBT and orchestrate workflows using Apache Airflow.
• Manage data storage and transformation in Snowflake and Iceberg tables on AWS S3.
• Work with Parquet data formats for downstream consumption in reporting.
• Monitor data pipeline performance and troubleshoot data issues.
• Collaborate with Quality Assurance (QA) teams and data scientists to ensure data quality and correctness.
• Follow coding best practices and participate in code reviews.

Qualifications

• Strong SQL skills and experience with PostgreSQL.
• Experience with Snowflake data warehouse and AWS S3 storage.
• Familiarity with DBT for data transformation and Apache Airflow for orchestration.
• Understanding of data lake house architecture, Iceberg tables, and Parquet format.
• Proficient in Python and API integration.
• Experience with handling large datasets and optimizing performance.
• Good communication and teamwork skills.
• Educational qualifications are not specified.

Preferred Skills

• Experience with other cloud platforms may be an advantage.

Experience

Years of experience required are not specified.

Environment

Typical work setting, location, and environmental conditions are not specified.

Salary

Estimated salary range is not specified.

Growth Opportunities

Potential career advancement opportunities within the company are not specified.

Benefits

Offered benefits, such as insurance, paid leave, or work policies are not specified.