Azure EDW Data Warehouse Engineer

Job Summary

We are seeking an experienced professional with expertise in designing and managing data warehouses on the Azure platform. The successful candidate will play a key role in loading star schema data warehouses using established framework architectures, including the handling of type 2 dimensions, and ingest data from various sources—both structured and semi-structured. This role also involves hands-on experience with API-based data ingestion to lakehouse architectures, supporting efficient data analysis and decision-making throughout the organization.

Responsibilities

• Design and load star schema data warehouses: Utilize framework architectures to create scalable and robust data warehouse solutions.
• Manage type 2 dimensions: Implement processes and strategies for handling slowly changing dimensions effectively.
• Ingest data from multiple sources: Develop and execute data ingestion from structured and semi-structured sources, including API-driven data pipelines.
• Utilize Azure technologies: Work hands on with Azure Databricks, Azure Data Factory, and Azure Data Lake Gen2 Storage to build and manage data workflows.
• Documentation and requirements gathering: Create and maintain Business Requirement Documents (BRD), Functional Requirement Documents (FRD), and user stories to document process and system requirements.
• Data analysis and SQL expertise: Perform complex data queries and analysis through expert-level SQL to support business insights.

Qualifications

• Azure Databricks: Proficiency in using this tool for data processing and analytics.
• Azure Data Factory: Experience in orchestrating and managing data workflows.
• Azure Data Lake Gen 2 Storage: Hands-on experience with cloud data storage solutions.
• SQL (Expert): Advanced skills in SQL for data query, analysis, and warehouse management.
• Python (Intermediate): Ability to develop scripts and data processing routines.
• Azure Cloud Services Knowledge: Understanding of various Azure cloud components and services.
• Data Warehousing and Analysis: Strong background in designing and managing data warehouses, with a focus on efficiency and scalability.
• Documentation Skills: Proven track record in developing BRD, FRD, and user story documentation.

Preferred Skills

• API Ingestion Techniques: Experience integrating data ingestion workflows with external API sources.
• Lakehouse Architecture: Familiarity with modern data lakehouse approaches and best practices.
• Problem-Solving and Analysis: Strong analytical and troubleshooting skills to resolve complex data issues.
• Agile Methodologies: Experience working in agile development environments.

Experience

Candidates should have relevant experience working with cloud-based data warehousing solutions and data ingestion processes. Prior exposure to handling type 2 dimensions and building frameworks for data integration on the Azure platform is highly desirable.

Environment

This role is designed for professionals comfortable with working in dynamic and collaborative settings. The work environment may include a blend of remote and in-office engagements, fostering an agile culture that supports continuous learning and innovation in a cloud-centric data ecosystem.