Senior Data Engineer

Company Overview

[Company details are not specified.]

Job Summary

The Senior Data Engineer will play a critical role in designing, building, and maintaining scalable data pipelines using Medallion architecture and Microsoft Synapse/Fabric along with Azure Data Factory (ADF). This position is essential for ensuring efficient data handling, transformation, and integration which aligns with the organization's strategic goals.

Responsibilities

• Design and implement data pipelines using Medallion architecture for optimized data processing.
• Utilize Microsoft Synapse/Fabric and Azure Data Factory (ADF) for data ingestion, transformation, and orchestration.
• Collaborate with data scientists and analysts to understand data requirements and ensure data quality.
• Monitor and troubleshoot data pipelines to maintain optimal performance and reliability.
• Implement best practices for data management, ensuring compliance with data governance policies.
• Provide technical guidance and mentorship to junior data engineers, fostering a culture of learning and improvement.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 5+ years of experience in data engineering or related roles.
• Strong proficiency in using Medallion architecture and Microsoft Synapse/Fabric.
• Hands-on experience with Azure Data Factory (ADF) for ETL processes.
• Proficient in SQL and data querying languages.
• Familiarity with cloud computing platforms, especially Microsoft Azure.
• Excellent problem-solving skills and ability to handle complex data challenges.
• Strong communication and teamwork abilities.

Preferred Skills

• Experience with data modeling and database design.
• Knowledge of programming languages such as Python or Spark.
• Familiarity with data visualization tools like Power BI or Tableau.
• Understanding of machine learning concepts and frameworks.

Experience

Minimum of 9 years of relevant experience in data engineering, particularly with tools and technologies mentioned.