Data Engineer

Company Overview

(Information about the company is not provided.)

Job Summary

We are looking for an experienced Data Engineer to join our growing data team. The ideal candidate will have a strong background in building and optimizing data pipelines, data architecture, and data sets. You will work closely with data scientists, analysts, and software engineers to support data initiatives and ensure that optimal data delivery architecture is consistent throughout ongoing projects.

Responsibilities

• Utilize knowledge of various data management technologies to drive data engineering projects.
• Support data acquisition efforts to gather data from various structured or semi-structured source systems of record to hydrate client data warehouse and power analytics across numerous health care domains.
• Leverage a combination of ETL/ELT methodologies to pull complex relational and dimensional data to support loading DataMarts and reporting aggregates.
• Detect data quality issues, identify root causes, implement fixes, and manage data audits to mitigate data challenges.
• Implement, modify, and maintain data integration efforts that improve data efficiency, reliability, and value.
• Create data transformations that address business requirements and other constraints effectively.
• Support the implementation of a modern data framework that facilitates business intelligence reporting and advanced analytics.
• Prepare high-level design documents and detailed technical design documents with best practices to enable efficient data ingestion, transformation, and data movement.
• Leverage DevOps tools for code versioning and code deployment.
• Monitor data pipelines to detect integrity issues before they result in user-visible outages or data quality issues.
• Continuously support technical debt reduction, process transformation, and overall optimization.

Qualifications

• Bachelor’s Degree (preferably in information technology, engineering, math, computer science, analytics, or a related field).
• 5+ years of experience in Microsoft Azure Cloud, Azure Data Factory, Data Bricks, Spark, Scala/Python, ADO.
• 5+ years of experience working with relational databases (SQL, Oracle).
• 5+ years of experience working with provider and payer data.
• 5+ years of combined experience in data engineering, ingestion, normalization, transformation, aggregation, structuring, and storage.
• 5+ years of experience working with industry-standard relational, dimensional, or non-relational data storage systems.
• 5+ years of experience in designing ETL/ELT solutions using tools like Informatica, DataStage, SSIS, PL/SQL, T-SQL, etc.
• 3+ years of experience working with healthcare data or data to support healthcare organizations.
• Working knowledge of various tools such as ALM, Rally, etc.
• Experience in US healthcare.

Preferred Skills

• Experience with streaming data platforms like Kafka or Kinesis.
• Knowledge of data warehousing concepts and tools.
• Familiarity with containerization (Docker, Kubernetes).
• Exposure to data governance and metadata management tools.
• Understanding of machine learning workflows and model deployment.

Experience

• A minimum of 5 years of relevant experience in data engineering and related technologies.

Environment

• Location: Hybrid (8 days a month in-office).
• Work from office locations include Noida, Gurgaon, Bangalore, and Hyderabad.

Salary

• Expected salary: 1.5L.

Growth Opportunities

(Information about growth opportunities is not provided.)

Benefits

(Information about benefits is not provided.)