Data Engineer

Company Overview

Company information is not specified.

Job Summary

The Data Engineer is responsible for designing, implementing, and managing data pipelines and infrastructures to support data analytics and business intelligence initiatives. This position plays a critical role in ensuring the quality and availability of data across various platforms, contributing to informed decision-making within the organization.

Responsibilities

• Develop and maintain robust data pipelines using Python/PySpark.
• Implement and manage data solutions through Azure Data Factory/Fabric or Databricks.
• Collaborate with cross-functional teams to understand data requirements and provide solutions.
• Automate processes and ensure smooth integration using CI/CD with tools such as GitLab and Azure DevOps (ADO).
• Write optimized queries and manage database interactions with SQL.
• Perform data quality checks and ensure accuracy across all datasets.

Qualifications

• Educational Background: Bachelor's Degree in Computer Science, Information Technology, or a related field.
• Experience Required: 9-12 years of relevant experience in data engineering roles.
• Proficiency in Python/PySpark for data processing.
• Strong familiarity with Azure Data Factory/Fabric and/or Databricks.
• Experience with CI/CD practices using GitLab and Azure DevOps (ADO).
• Solid understanding of database querying using SQL.
• Knowledge of data warehousing concepts and data modeling techniques.
• Excellent problem-solving skills and ability to work in a team environment.

Preferred Skills

• Experience with big data technologies and frameworks.
• Knowledge of data governance and data security best practices.
• Familiarity with cloud-based architecture beyond Azure.

Experience

• 9-12 years of experience in data engineering or similar roles.

Environment

• The position is based in Bangalore.
• The work environment is expected to be collaborative, with opportunities for remote work depending on company policies.

Salary

• Estimated salary range is 25 lpa.

Growth Opportunities

Career advancement opportunities are not specified.

Benefits

Benefits offered are not specified.

Client Name: Hexaware