Principal Engineer (Big Data + Data Science)

Company Overview

Not specified

Job Summary

The Data Engineer role focuses on the development and maintenance of data engineering solutions that support the organization’s analytical and operational needs. This position involves collaborating with various stakeholders to design scalable data architectures and improve overall engineering processes.

Responsibilities

• Design and implement robust data engineering solutions including pipeline development and data processing.
• Collaborate with stakeholders to translate technical requirements into actionable plans.
• Propose scalable designs and make recommendations for managing technical debt and code quality.
• Evaluate and improve the technical aspects of project delivery while providing recommendations for process improvements.
• Lead efforts in creating technical requirements, conducting feasibility studies, and project planning.
• Investigate and analyze complex software issues, providing recommendations for root cause analysis and resolution.

Qualifications

• Educational Background: Bachelor's degree in Computer Science, Engineering, or a related field.

• Technical Skills:

  • Proficiency in Data Engineering tools: Spark, Scala, Kafka, Hadoop/HDFS/Hive/Redshift/Flume/Sqoop.
  • Experience with the Big Data Ecosystem and distributed systems.
  • Familiarity with cloud infrastructure, specifically AWS, and exposure to Azure.
  • Knowledge of Data Science and machine learning models including Linear, Logistic Regression, Decision Trees, etc.
  • Strong understanding of software methodologies, tools, and processes.
  • Proficient in code versioning tools (e.g., GitHub, GitLab, Stash).
  • Experience with performance tuning and secure coding practices.

• Soft Skills:

  • Strong planning, communication, organization, and leadership skills.
  • Creative problem-solving abilities and the capacity to articulate technical details clearly to both technical and non-technical stakeholders.
  • Ability to work in fast-paced environments with a focus on deadlines, prioritization, and budgeting diligence.
  • Critical thinking skills and capacity to assess and evolve architectures with modern technologies.

Preferred Skills

• Experience with automated static analysis, code coverage, and testing tools.
• Strong Agile process experience and hands-on design and development guidance skills.
• Familiarity with non-functional requirements across varying levels of scaling.

Experience

Not specified

Environment

Not specified

Salary

Not specified

Growth Opportunities

Not specified

Benefits

Not specified