Senior Data Engineer (Contract)

Job Summary

The Senior Data Engineer plays a crucial role in designing, developing, and optimizing scalable data pipelines that support the organization's data initiatives. This position will work closely with cross-functional teams to ensure high-quality data solutions that meet business requirements while maintaining data integrity and security.

Responsibilities

• Design, develop, and optimize scalable data pipelines using PySpark and Databricks.
• Implement and manage data workflows in Azure Data Factory (ADF).
• Work with large-scale Big Data technologies including Hadoop, Hive, and related ecosystems.
• Collaborate with cross-functional teams to understand data requirements and deliver high-quality solutions.
• Ensure data quality, integrity, and security across all stages of the data lifecycle.
• Troubleshoot and resolve data-related issues in a timely manner.

Qualifications

• 8+ years of relevant experience in data engineering and related fields.
• Strong hands-on experience with PySpark, Databricks, and Azure Data Factory (ADF).
• Proficiency in Big Data technologies: Hadoop, Hive.
• Solid understanding of data architecture, ETL processes, and performance optimization.
• Experience working in hybrid environments and managing distributed data systems.
• Excellent problem-solving and communication skills.

Preferred Skills

• Familiarity with additional big data tools and frameworks.
• Experience in data modeling and database design.

Experience

• A minimum of 8 years of relevant experience in data engineering, with a focus on Big Data technologies.

Environment

• The role is hybrid, requiring 2 to 3 days in office weekly in Noida, Gurgaon, or In