Data Engineer

Job Summary

The Data Engineer is responsible for designing and building scalable data solutions that support data analytics, ensuring data quality and system performance, and maintaining robust ETL pipelines to meet business requirements.

Responsibilities

• Design database schemas and write queries and functions for common data extraction tasks.
• Develop and maintain high-quality ETL data pipelines in line with system requirements and business needs to ensure optimal performance and reliability.
• Utilize SQL and Adobe Query Service for data transformation and merging.
• Implement data solutions using Python, JavaScript, and integrate with APIs while working with large-scale datasets.
• Leverage API tools such as Postman and Hoppscotch, along with CI/CD tools, version control (Git), and apply DevOps practices related to data pipelines.
• Work with real-time event streaming technologies.
• Ensure compliance with data privacy regulations (e.g., GDPR, CCPA) and be knowledgeable about consent frameworks (AEP DULE).

Qualifications

• Education: Bachelor's degree in Computer Science, Information Technology, or related field.
• Experience: 3–6 years in data engineering, analytics implementation, or quality engineering roles; 5-8 years preferred for senior associate level.
• Proficient in SQL and Adobe Query Service.
• Strong programming skills in Python and JavaScript.
• Familiarity with API interaction and tools such as Postman and Hoppscotch.
• Knowledge of CI/CD tools, and version control systems (Git).
• Understanding of data privacy regulations including GDPR and CCPA.

Preferred Skills

• Familiarity with real-time event streaming technologies.
• Experience in working with large-scale datasets.
• Knowledge of data architecture best practices.

Experience

• 3–6 years in relevant experience for a standard role; 5-8 years for a senior associate position.

Environment

• Work locations include Gurgaon, Noida, and Bangalore.