Data Engineer | Codersbrain
Job Description
Job Title: Data Engineer (Java + Spark)
Experience:
-
4–5 Years
-
5–8 Years
Location: All PSL Locations (PAN India)
Work Mode: Hybrid (if applicable)
Job Description:
We are seeking a skilled Data Engineer with strong expertise in Java and Apache Spark to join our dynamic engineering team. This role is ideal for professionals with solid backend programming skills and a deep understanding of data processing pipelines and distributed computing frameworks.
Key Responsibilities:
-
Design, develop, and maintain scalable and reliable data pipelines using Java and Apache Spark.
-
Work with large volumes of structured and semi-structured data from diverse sources.
-
Collaborate with business and analytics teams to understand data requirements and deliver appropriate solutions.
-
Optimize data processing and transformation jobs for performance and scalability.
-
Ensure robust version control and continuous integration/deployment using Git and CI/CD tools.
-
Participate in Agile/Scrum ceremonies and contribute to the team’s delivery commitments.
-
Communicate effectively with internal teams and external stakeholders via email and calls.
Required Skills:
-
Proficiency in Java with a deep understanding of core libraries and multithreading.
-
Hands-on experience in Apache Spark, including knowledge of Spark Core, Spark SQL, RDDs, DataFrames, and Datasets.
-
Basic Linux skills, including shell scripting and command-line operations.
-
Experience using Git and Git Bash for version control and collaboration.
-
Strong problem-solving skills and attention to detail.
-
Excellent communication skills, including professional email writing and client interaction