Big Data PySpark Developer

Job Summary

We are seeking a Big Data PySpark Developer with a minimum of 5 years of experience to effectively manage and analyze large datasets using PySpark across Pan India. The candidate will play a crucial role in implementing big data solutions that help transform raw data into actionable insights, directly contributing to the organization’s goals.

Responsibilities

• Develop and execute data processing solutions using PySpark.
• Collaborate with data engineers and analysts to optimize data pipelines and workflows.
• Design, implement, and maintain large-scale data processing systems.
• Troubleshoot and resolve issues related to data processing and software performance.
• Ensure data quality and availability through effective monitoring and maintenance.
• Prepare and present analytical reports to stakeholders, aiding in decision-making processes.

Qualifications

• Strong experience with Big Data technologies, specifically PySpark.
• Proficient in SQL and familiarity with data warehousing concepts.
• Knowledge of Hadoop ecosystem components such as HDFS, MapReduce, and Spark.
• Understanding of data modeling and ETL best practices.
• Ability to work in a fast-paced, agile environment.
• Strong problem-solving and analytical skills.
• Excellent communication and teamwork abilities.
• Bachelor’s degree in Computer Science, Information Technology, or related field.

Preferred Skills

• Experience with cloud platforms like AWS or Azure.
• Familiarity with machine learning libraries and frameworks.
• Knowledge of scripting languages such as Python or Scala.
• Previous experience in data visualization tools like Tableau or Power BI.

Experience

• Minimum of 5 years of relevant experience in Big Data technologies with a strong focus on PySpark.