Senior AWS Data Engineer

Job Summary

We are seeking a highly skilled and experienced Senior AWS Data Engineer to join our remote team and lead the design, development, and optimization of scalable data infrastructure and pipelines. This role requires a deep understanding of data warehousing, ETL/ELT processes, cloud-native tools, and big data technologies, with a primary focus on Amazon Web Services (AWS).

Responsibilities

• Lead the design and implementation of scalable, high-performance data architectures to support analytics and reporting.
• Develop and manage robust ETL/ELT pipelines using AWS services such as AWS Glue, Database Migration Service (DMS), Amazon Redshift, Amazon S3, and AWS Lambda.
• Orchestrate workflows using Apache Airflow and ensure timely data delivery and transformation.
• Collaborate with stakeholders to define data requirements, data models, and performance metrics.
• Apply data warehousing best practices and optimize queries, data models, and storage strategies for performance and cost-efficiency.
• Ensure data quality and integrity through thorough testing, validation, and monitoring.
• Write clean, efficient code using Python, PySpark, and SQL to process and analyze large datasets.
• Implement infrastructure-as-code practices using Terraform, and manage Continuous Integration/Continuous Deployment (CI/CD) pipelines for data engineering workflows.
• Work closely with cross-functional teams to support data-driven decision-making and application development.

Qualifications

• Extensive experience in data engineering with a focus on AWS services.
• Proficiency in ETL/ELT processes and technologies.
• Strong knowledge of data warehousing concepts and best practices.
• Experience with big data technologies and cloud-native tools.
• Proficiency in programming languages such as Python, PySpark, and SQL.
• Familiarity with Apache Airflow for workflow orchestration.
• Knowledge of Terraform for infrastructure management.
• Excellent problem-solving and analytical skills.
• Effective communication skills to collaborate with various stakeholders.

Preferred Skills

• Certifications in AWS or related data engineering fields would be advantageous.
• Experience with additional AWS services like Redshift Spectrum, Amazon Athena, or Amazon EMR.
• Familiarity with data governance and compliance standards.

Experience

• A minimum of 5 years of experience in data engineering or related field, with significant experience in AWS.