Senior Data Engineer (4–8 Years)

Company Overview

Information about the company is not specified.

Job Summary

The Senior Data Engineer will be responsible for designing, building, and optimizing large-scale data pipelines on cloud-native platforms. This role plays a critical part in ensuring the efficiency, scalability, and integrity of data processes, while collaborating with various stakeholders to deliver seamless data solutions aligned with the organization’s goals.

Responsibilities

• Design, build, and optimize large-scale data pipelines on cloud-native platforms.
• Develop and maintain ETL processes ensuring efficiency, scalability, and data integrity.
• Collaborate with data scientists, analysts, and business stakeholders to deliver end-to-end data solutions.
• Implement best practices for data governance, version control, and CI/CD automation.
• Monitor and fine-tune performance of Spark/Databricks workloads in production.

Qualifications

• Cloud Platforms: Strong experience in Azure or AWS, with specific expertise in Databricks.
• Programming & Big Data: Proficiency in Python, Scala, Spark, and PySpark.
• Databases & Querying: Advanced expertise in SQL, with exposure to Hive, HBase, Impala, and Parquet.
• Workflow Orchestration: Hands-on experience with Apache Airflow.
• Streaming & Messaging Systems: Experience with Kafka for real-time data processing.
• CI/CD & DevOps: Practical experience in Jenkins or Bamboo, version control (GitHub or Bitbucket), and artifact management (Nexus).
• Delta Live Tables (DLT): Knowledge or experience preferred.
• Educational qualifications are not specified but typically a Bachelor's degree in Computer Science or a related field is desired.

Preferred Skills

• Familiarity with data governance frameworks.
• Experience with data modeling and data architecture.

Experience

• 6–8 years of relevant experience in data engineering and design.

Environment

• This role is on-site in Gurgaon or Pune.

Salary

Salary information is not specified.

Growth Opportunities

Opportunities for career advancement within the company are not specified.

Benefits

Benefits information is not specified.