Data Engineer

Company Overview

Not specified

Job Summary

We are seeking a highly skilled Data Engineer to join our team, focusing on end-to-end data engineering and data science use cases. The ideal candidate will have a strong expertise in Python or Scala, Spark (Databricks), and SQL, with proven experience in building scalable and efficient data pipelines on Azure, contributing to the organization's data-driven goals.

Responsibilities

• Design, build, and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Databricks, and Spark.
• Develop and optimize workflows using SQL and Python/Scala for large-scale data processing.
• Implement performance tuning for data pipelines and Spark jobs.
• Support feature engineering, model deployment, and end-to-end workflows.
• Ensure data quality and integrity with robust validation and monitoring.
• Work with structured and unstructured data using Delta Lake and Parquet.

Qualifications

• Proficiency in Azure Data Factory, Databricks, Blob Storage, and Azure Data Lake Storage (ADLS).
• Strong expertise in SQL and Python or Scala.
• Hands-on experience with ETL/ELT pipelines and Big Data technologies (Spark, Delta Lake, Parquet).
• Experience in pipeline optimization, Continuous Integration/Continuous Deployment (CI/CD), and data validation.
• Excellent analytical and problem-solving skills.

Preferred Skills

• Knowledge of data governance, security, and compliance in hybrid/cloud environments.
• Familiarity with data governance frameworks.

Experience

• Minimum of 6+ years of experience in Data Engineering.

Environment

• This position is based in Bangalore. Candidates must be located in Bangalore.

Salary

Estimated salary range: ₹1.5 – 1.7 Lakhs per month.

Growth Opportunities

Not specified

Benefits

Not specified