Sr. Data Engineer

Company Overview

Information about the company is not specified.

Job Summary

As a Senior Data Engineer in the Data Warehouse team, you will independently develop and deliver high-quality features and complete tasks to a high standard. You will play a crucial role in an emerging team that focuses on building and improving innovative BNL Data Warehouse offerings utilizing marketing suites.

Responsibilities

• Independently develop and implement backend and data engineering solutions.
• Design and develop data warehouse architecture based on business requirements using modern data warehouses.
• Build cloud-native, data-intensive applications with a strong emphasis on Amazon Web Services (AWS).
• Architect and implement workflow management systems, primarily using Apache Airflow.
• Optimize and maintain Spark applications.
• Collaborate in code reviews and provide quality, readable business documentation, as well as accept and give constructive feedback.

Qualifications

• Minimum of 8 years of experience in software development, with a focus on data structures and algorithms.
• 5+ years of hands-on experience with Python, JVM, and Shell Scripting in production environments.
• At least 3 years of experience building cloud-native data-intensive applications, with mandatory experience in AWS and knowledge of Google Cloud Platform (GCP) preferred.
• Required experience with Databricks and dbt for data warehouse development.
• Proficient in architecting workflow management systems, specifically using Apache Airflow.
• Experience with containerization and orchestration technologies such as Docker and Kubernetes.
• Fundamental understanding of file formats, including Parquet and Delta Lake.
• Proficient with Infrastructure as Code (IaC) tools such as Terraform, AWS Cloud Development Kit (CDK), or CloudFormation.
• Familiarity with observability systems like Datadog or Prometheus/Grafana.
• Strong experience in building Continuous Integration/Continuous Deployment (CI/CD) processes, with familiarity in tools like GitHub Actions, ArgoCD, or Jenkins.
• Experience in unit testing and utilizing test automation frameworks.
• Service-oriented mindset towards internal customers, with a strong focus on delivering business value.

Preferred Skills

• Additional experience in unit testing and test automation frameworks is a plus.
• Familiarity with CI/CD tools beyond those mentioned may be advantageous.

Experience

• A minimum of 8 years of total experience, with at least 5 years in data engineering or similar roles.

Environment

• Work locations include Jaipur, Pune, Gurgaon, Chennai, Bhopal, and Bangalore. More information about the work setting is not specified.

Salary

• The budget for this role is 1.6 Lakhs per annum.

Growth Opportunities

Information about potential career advancement opportunities is not specified.

Benefits

Information about offered benefits is not specified.