Job Summary

The role is aimed at utilizing strong programming skills in PySpark and Java/Scala to develop and maintain data processing applications. The successful candidate will contribute to the organization by leveraging big data technologies and ensuring efficient data workflows.

Responsibilities

• Develop and maintain data processing applications using PySpark and Java/Scala.
• Design and implement ETL (Extract, Transform, Load) workflows within a distributed computing environment.
• Collaborate with teams to utilize big data frameworks like Hadoop, Hive, or HDFS for data handling.
• Ensure data warehousing concepts are effectively applied to the workflows.
• Work with cloud platforms such as AWS, Azure, or GCP to enhance data solutions.
• Utilize job orchestration tools such as Apache Airflow, Oozie, or NiFi as needed.

Qualifications

• Strong programming skills in PySpark and Java/Scala.
• Experience with big data frameworks including Hadoop, Hive, and HDFS.
• Proficiency in designing and implementing ETL workflows in a distributed computing environment.
• Familiarity with data warehousing concepts and SQL.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP) is preferred.
• Knowledge of job orchestration tools like Apache Airflow, Oozie, or NiFi is a plus.
• Strong problem-solving and debugging skills particularly in large-scale systems.
• Minimum 5+ years of relevant experience.

Preferred Skills

• Additional experience with data visualization tools.
• Knowledge of machine learning frameworks could be beneficial.

Experience

• A minimum of 5 years in a relevant field, particularly in big data technologies and environments.

Environment

The typical working environment is in Hyderabad, with potential collaboration over cloud platforms. The working setup details such as remote or in-office are not specified.

Salary

Not specified.

Growth Opportunities

Not specified.

Benefits

Not specified.