Azure Data Engineer

Company Overview

Company details are not specified.

Job Summary

The Azure Data Engineer will play a crucial role in designing and implementing data integration solutions using Azure technologies. This position is responsible for developing ETL pipelines, data ingestion mechanisms, and ensuring optimal data processing to meet the analytical needs of the organization.

Responsibilities

• Develop and maintain ETL pipelines using Azure Databricks, Apache Spark, and Azure Data Factory for batch and real-time data integration.
• Write and optimize Stored Procedures and work with relational data processing technologies like MS SQL, Delta Lake, and Spark SQL.
• Design and build end-to-end data architecture for Data Lakes, Data Warehouses, and Data Marts.
• Collaborate with cross-functional teams to define data requirements and create optimal solutions for data ingestion and operationalization.
• Utilize orchestration tools, Azure DevOps, and GitHub to manage version control and deployment processes.
• Provide forward-thinking solutions in data and analytics to enhance the organization's data capabilities.

Qualifications

• Minimum 8 years of experience in Data Engineering.
• Proficient in ETL and Data Warehousing concepts, strategies, and methodologies.
• Strong programming skills in Scala or Python.
• Experience with cloud data warehouses such as Azure Synapse and Snowflake Analytical Warehouse.
• Extensive experience in data ingestion, preparation, and integration techniques.
• Excellent communication skills, both written and verbal, with the ability to present complex information clearly.
• Familiarity with Azure services such as Azure Functions, Azure Data Lake Store, and Azure Cosmos.
• Exposure to Healthcare business data models is a plus.

Preferred Skills

• Knowledge of Orchestration tools.
• Strong collaboration and adaptability skills.
• Ability to prioritize tasks effectively.

Experience

• Minimum of 8 years of experience in Data Engineering roles with a focus on cloud technologies and data integration.

Environment

• Position is Remote with an expectation to meet in person once a month.

Salary

• Estimated salary budget of $140,000 per year.

Growth Opportunities

Career advancement opportunities within the company are not specified.

Benefits

Details about offered benefits are not specified.