Scala Data Engineer

Company Overview

No specific company information was provided.

Job Summary

The Scala Data Engineer will play a crucial role in building and optimizing scalable data pipelines to support the organization’s data needs. This position focuses on creating reliable data systems while mentoring junior engineers and ensuring high coding standards.

Responsibilities

• Build and optimize scalable data pipelines using Apache Spark and Scala.
• Develop streaming pipelines with Kafka/Event Hubs.
• Own the design and architecture of data systems with a strong focus on performance and reliability.
• Mentor junior engineers and enforce high-quality coding standards.
• Collaborate across teams and contribute to product delivery.

Qualifications

• 8–15 years of experience in data engineering.
• Proficiency in Scala (preferred over Java) and SQL.
• Strong experience with Apache Spark.
• Excellent knowledge of data structures and algorithms.
• Hands-on experience in data engineering on large-scale systems.
• Exposure to cloud-native environments (preferably Azure).
• Familiarity with Hadoop, Kafka, and streaming technologies (structured streaming/event hubs).
• Experience with CI/CD tools (e.g., Git, Docker, Jenkins).
• Knowledge of medallion architecture, Apache Parquet, Apache Iceberg, and orchestration tools (e.g., Airflow, Oozie).
• Experience with NoSQL databases and data governance tools (e.g., Alation, Collibra, data lineage, and metadata).

Preferred Skills

• Familiarity with Hadoop and Kafka.
• Experience in data streaming using structured streaming.
• Knowledge of CI/CD tools like Git, Docker, and Jenkins.

Experience

• Minimum of 8 years relevant experience, with up to 15 years preferred.

Environment

• Location: Bangalore (Whitefield).
• Mode: Hybrid (3 days working from office per week).

Salary

• Estimated monthly budget of 1.8 LPM + GST.