Data Engineer

Company Overview

(Company information not provided)

Job Summary

The Data Engineer will be responsible for developing and maintaining scalable data pipelines, managing real-time data workflows, and building machine learning models. This role is crucial for ensuring the reliability and performance of data assets, ultimately contributing to effective decision-making within the organization.

Responsibilities

• Develop and maintain scalable data pipelines using Python, Java, Scala, and PySpark with Big Data technology (Hadoop, Spark, Scala).
• Build, train, and optimize machine learning (ML) models using frameworks like PyTorch, TensorFlow, Keras, and XGBoost.
• Design and manage real-time data workflows leveraging Kafka, SQL, and MongoDB.
• Create dashboards and provide insights using Tableau or Power BI to support decision-making.
• Utilize cloud platforms such as Azure or Databricks to deploy and operationalize data and ML solutions.
• Ensure the reliability, scalability, and performance of data assets.
• Design and maintain quality indicators along with the corresponding monitoring and alerting systems.
• Troubleshoot and document issues in compliance with Amadeus standards.
• Apply a continuous improvement mindset to data-related issues, systems, and processes.

Qualifications

• Proficiency in programming languages including Python, Java, and Scala.
• Experience with Big Data technologies such as Hadoop and Spark.
• Knowledge of machine learning frameworks including PyTorch, TensorFlow, Keras, and XGBoost.
• Familiarity with data management tools such as Kafka, SQL, and MongoDB.
• Strong skills in creating dashboards using Tableau or Power BI.
• Experience utilizing cloud platforms like Azure or Databricks.
• Excellent problem-solving and troubleshooting abilities.
• Strong attention to detail and commitment to performance quality.

Preferred Skills

• Knowledge of data governance and best practices in data quality management.
• Experience with data visualization and reporting tools.
• Understanding of security practices in cloud environments.

Experience

(Minimum experience not specified)

Environment

(Work setting details not specified)

Salary

(Salary information not provided)

Growth Opportunities

(No information provided on advancement opportunities)

Benefits

(No benefits listed)