Data Engineer | Codersbrain
Job Description
Data Engineer
Company Overview
Company Overview details are not specified.
Job Summary
The Data Engineer will be responsible for designing, building, and maintaining robust data pipelines and architectures. The role aims to facilitate the transformation and utilization of data to meet the organization’s analytical needs.
Responsibilities
- Develop and maintain scalable data models and ETL pipelines utilizing PySpark and SQL.
- Optimize and troubleshoot existing data structures and workflows for performance improvements.
- Collaborate with data scientists and analysts to understand data requirements and deliver solutions that meet those needs.
- Ensure data quality and integrity throughout the data lifecycle.
- Document data processes and workflows to maintain clarity and communication within the team.
Qualifications
- Experience: Minimum of 8 years in data engineering or related field.
- Technical Skills:
- Proficient in PySpark and Apache Spark.
- Strong knowledge of SQL for interaction with databases.
- Familiarity with data warehouse concepts and architectures.
- Experience in cloud data solutions (e.g., AWS, Azure, Google Cloud).
- Soft Skills:
- Excellent problem-solving abilities.
- Strong communication skills for effective collaboration with cross-functional teams.
- Educational Qualifications: Relevant degree in Computer Science, Engineering, or a related field is preferred.
Preferred Skills
- Familiarity with machine learning concepts and tools.
- Experience with data visualization tools.
- Knowledge of programming languages like Python or Java.
Experience
A minimum of 8 years of relevant experience in data engineering or related roles.
Environment
This position is remote, allowing for flexibility in work location.
Salary
The estimated budget for this position is 1.3 Lakh Per Month + GST.
Growth Opportunities
Growth opportunities within the company are not specified.
Benefits
Benefits offered by the company are not specified.
Note: Candidates will need to provide documents such as Aadhar, PAN, educational documents, experience letters from previous companies, and LinkedIn ID after the first technical round.