Senior Data Engineer

Company Overview

It’s a Series B funded fast-growing SaaS startup operating in the cybersecurity and identity management space.

Job Summary

The Senior Data Engineer will play a crucial role in developing and maintaining the data infrastructure. This position focuses on designing efficient and scalable data pipelines, optimizing data processing, and collaborating with various teams to enhance data workflows. The ideal candidate will contribute to the foundational architecture that supports it’s identity governance platform.

Responsibilities

• Design, build, and maintain efficient and scalable data pipelines that collect, transform, and load data.
• Develop and implement Logical Data Models and Physical Data Models, including data warehouse designs.
• Implement monitoring and alerting systems to ensure data pipeline reliability and perform routine maintenance tasks.
• Collaborate with upstream and downstream teams to ensure end-to-end execution of data pipelines.
• Streamline workflows and help set up processes for the growth and expansion of the team.
• Optimize data processing and storage solutions for efficiency and scalability when handling large data volumes.
• Work with modern data technologies such as Spark, Flink, Iceberg, and Parquet.

Qualifications

• Education: Bachelor’s Degree in Computer Science, Software Engineering, Information Technology or a related field.
• Experience: 3-6 years working on ETL pipelines.
• Key Skills:
  • Strong programming skills in Python for data manipulation and transformation.
  • In-depth knowledge of either a NoSQL or relational database, with ability to model data effectively.
  • Experience with workflow management tools such as Apache Airflow.
  • Proficiency in all phases of development, including design, implementation, and operation of production systems.
  • Solid understanding of Object-Oriented design and concepts, with capability to produce high-quality code.
  • Ability to navigate and resolve ambiguous or undefined problems.
  • Knowledge of data security and privacy principles.

Preferred Skills

• Familiarity with additional programming languages and data processing frameworks.
• Experience in cloud data platforms and services.
• Understanding of advanced data governance principles and practices.

Experience

A minimum of 3-6 years of relevant experience in data engineering, specifically in building and maintaining ETL pipelines.

Environment

The position is based in Whitefield, Bangalore, and may involve collaboration with cross-functional teams in a hybrid work environment.

Salary

Salary details are not specified.

Growth Opportunities

Career advancement opportunities may include leadership roles in data architecture, data governance, or other engineering disciplines.

Benefits

The company promotes diversity and inclusivity in the workplace, providing equal opportunities for all qualified applicants regardless of race, color, religion, gender, gender identity, sexual orientation, national origin, genetics, disability, age, or veteran status. Specific benefits are not listed.