ADB Pyspark

Job Summary

We are seeking an experienced ADB Pyspark professional to join our team as a full-time employee. The ideal candidate will be responsible for developing, optimizing, and maintaining big data solutions using Databricks Spark and PySpark SQL. You will play a key role in handling large-scale data processing tasks and support our data engineering initiatives to drive business outcomes. Immediate joiners are preferred.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks Spark and PySpark SQL.
• Collaborate with cross-functional teams to understand data requirements and deliver efficient solutions.
• Optimize existing data workflows for performance, reliability, and scalability.
• Implement best practices for data ingestion, transformation, and storage.
• Troubleshoot and resolve data pipeline and processing issues.
• Document technical solutions and provide knowledge sharing to team members.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
• Minimum of 5 years of professional experience working with Databricks Spark and PySpark SQL.
• Strong expertise in building and optimizing data pipelines in distributed data environments.
• Proficient in writing complex SQL queries for data extraction and transformation.
• Solid understanding of big data concepts and architecture.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork abilities.

Preferred Skills

• Experience with cloud data platforms (such as Azure, AWS, or Google Cloud Platform).
• Familiarity with data warehousing and ETL concepts.
• Exposure to additional big data technologies (e.g., Hadoop, Hive).
• Experience in Agile/Scrum development environments.

Experience

• Minimum 5 years of relevant experience in Databricks Spark and PySpark SQL.
• Hands-on experience with large-scale data processing, data pipeline development, and optimization.

Environment

• Work Location: Bangalore or Chennai (in-office).
• Employment Type: Full-Time.
• Start Date: Immediate.
• Collaborative, fast-paced, and technology-driven environment.

Salary

• INR 12,00,000 – 17,00,000 per annum.

Deadline

• Application Deadline: 30 May 2025, 6:30 PM IST.