Technical Engineer - Data Frameworks

Company Overview

Company information is not specified.

Job Summary

The Technical Engineer will be responsible for developing and implementing frameworks focused on logging, monitoring, and data quality. This role is essential to enhancing observability and ensuring data integrity within various applications. Working under the guidance of the NT Architect, the engineer will create proof of concepts (PoCs) and facilitate the deployment of frameworks that development teams will utilize in their projects.

Responsibilities

• Develop frameworks for logging using tools such as Synapse, SQL, Python/PySpark.
• Establish monitoring solutions with Azure Monitor, Dynatrace, and AppServices/LogicApps.
• Implement data quality measures for both data in motion and at rest, utilizing frameworks such as GreatExpectations.
• Execute proof of concepts (PoCs) for frameworks and assist in their deployment.
• Create observability dashboards in Power BI to visualize data and system performance.
• Collaborate with development teams to ensure effective adoption and usage of these frameworks.

Qualifications

• Primary Skills:
  • Azure Synapse
  • SQL
  • Python/PySpark
  • App Services/Logic Apps
• Secondary Skills:
  • Azure Monitor
  • Dynatrace
• Bachelor’s degree in Computer Science, Engineering, or a related field is preferred.
• Strong problem-solving and analytical skills.
• Effective communication and collaboration capabilities.

Preferred Skills

• Experience with data quality frameworks like GreatExpectations.
• Familiarity with observability tools and dashboarding in Power BI.

Experience

• 4-7 years of relevant experience in data engineering or similar technical roles.

Environment

Details of the work setting, location (remote, in-office, hybrid), and any physical or environmental conditions are not specified.

Salary

Salary information is not provided.

Growth Opportunities

Details regarding potential career advancement opportunities within the company are not specified.

Benefits

Information on offered benefits is not provided.