Senior Data Engineer

Company Overview

(Company information not specified.)

Job Summary

The Senior Data Engineer will play a critical role in assembling, optimizing, and delivering large complex data sets for the Finance Data Warehouse, meeting both functional and non-functional business requirements. This position will contribute significantly to the organization's goals by ensuring efficient data integration, modeling, and orchestration, while also guiding the team towards continuous improvement and innovation.

Responsibilities

• Coordinate with multiple data source teams to publish data to the Finance Data Warehouse.
• Work with stakeholders, including data, design, product, and executive teams, to assist with data-related and technical issues.
• Build scalable data pipelines to generate training datasets for machine learning deliverables.
• Mentor junior resources and drive the end-to-end design, implementation, and delivery of engineering components.
• Strive for continuous improvement of code quality and development practices.
• Anticipate system/application challenges and propose effective solutions.

Qualifications

• BS in Computer Science or a related field.
• 5+ years of data engineering experience.
• Strong understanding of modern data platforms, including data lakes and data warehouses, with particular knowledge in Snowflake architecture.
• Proven experience in assembling large complex data sets that meet business requirements.
• Experience with integration, modeling, and orchestration of complex finance data while optimizing processes.
• Proficient in scripting, data science, and analytics using SQL, Python, PowerShell, and JavaScript.
• Skilled in performance tuning, optimization, and troubleshooting in ambiguous environments.
• Proficient in working with cloud-based systems, preferably Azure.

Preferred Skills

• Experience with cloud-based systems, specifically Azure and Snowflake data warehouses.
• Expertise in designing data table structures, reports, and queries.
• Knowledge of Continuous Integration/Continuous Deployment (CI/CD).
• Experience in building data integrity checks as part of application delivery.
• Familiarity with Kafka technologies.
• Experience with real-time analytics and messaging.
• Working knowledge of Microservices is desirable.
• MS in Computer Science or a related technical degree is preferred.
• Experience with large volume data, particularly in retail.

Experience

• A minimum of 5 years of relevant experience in data engineering.

Environment

• (Work setting, location, and physical conditions not specified.)

Salary

• (Salary range not specified.)

Growth Opportunities

• (Potential career advancement opportunities not specified.)

Benefits

• (Offered benefits not specified.)