AWS Data Engineer

Company Overview

Company information is not specified, but we are looking for an innovative and driven individual to join our data engineering team.

Job Summary

The AWS Data Engineer will play a crucial role in the design and development of data processing systems using AWS technologies. The individual will be responsible for building, maintaining, and optimizing data pipelines to ensure efficient data analytics and reporting.

Responsibilities

• Develop and maintain data processing workflows using AWS Glue, including handling Crawlers, Jobs, and Workflows.
• Utilize Apache Spark and big data technologies to process large datasets efficiently.
• Write Python and PySpark scripts for data manipulation and transformation.
• Build complex SQL queries for data analysis and reporting, ensuring high-quality data outputs.
• Implement and manage data analytics solutions with AWS services such as S3, Redshift, Athena, and Lambda.
• Apply ETL/ELT methodologies and data warehousing concepts to enhance data pipeline efficiency.

Qualifications

• Strong knowledge of AWS Glue and its components (Glue Studio, Crawlers, Jobs, Workflows).
• Proficient in Apache Spark for big data processing.
• Experience with Python and PySpark for data engineering tasks.
• Solid understanding of SQL for querying and analyzing data.
• Familiarity with AWS data analytics services (S3, Redshift, Athena, Lambda).
• Understanding of ETL/ELT methodologies and data warehousing concepts.
• Bachelor’s degree in Computer Science, Information Technology, or a related field.

Preferred Skills

• Knowledge of additional AWS services and tools related to data integration and analytics.
• Experience with data modeling and data architecture principles.

Experience

• A minimum of 6+ years of experience in data engineering, specifically with AWS technologies.

Environment

• The position is based in Bangalore, Chennai, or Hyderabad.
• Flexible work arrangements may be available, such as remote or hybrid working environments.

Salary

Salary information is not specified.

Growth Opportunities

Career advancement opportunities within the organization are available, and high-performing team members may progress to senior positions or specialized roles.

Benefits

Benefits information is not specified, but the organization typically offers competitive benefits packages, including health insurance and paid leave.