Data Engineer

Company Overview

(No specific details provided.)

Job Summary

The Data Engineer will be responsible for utilizing technologies such as PySpark and SQL, along with Microsoft Fabric, to develop and maintain data processing systems. This role is essential for enabling data-driven decision-making within the organization.

Responsibilities

• Design, build, and maintain scalable data pipelines using PySpark.
• Write complex SQL queries for data extraction and analysis.
• Collaborate with data scientists and analysts to support their data needs.
• Implement data quality checks to ensure the integrity and accuracy of data.
• Optimize existing data workflows for efficiency and performance.

Qualifications

• Technical Skills:
  • Proficiency in PySpark.
  • Strong knowledge of SQL.
  • Familiarity with Microsoft Fabric.
• Educational Qualifications: Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Soft Skills:
  • Strong problem-solving abilities.
  • Excellent communication and collaboration skills.
  • Attention to detail.

Preferred Skills

• Experience with cloud platforms (e.g., Azure, AWS).
• Knowledge of data warehousing and ETL processes.

Experience

• 5 to 8 years of relevant experience in data engineering or related fields.

Environment

(No specific details provided.)

Salary

(No specific details provided.)

Growth Opportunities

(No specific details provided.)

Benefits

(No specific details provided.)