Azure, Datastage, Databricks, ETL, SQL | Codersbrain
Job Description
ETL Professional
Company Overview
Company details are not specified.
Job Summary
We are seeking a skilled ETL professional with hands-on experience in IBM Datastage and Databricks to support documentation and knowledge transfer for a migration project. The ideal candidate will analyze existing ETL logic, decode complex data transformations, and create clear, implementation-ready documentation for Spark/Databricks developers.
Responsibilities
- Analyze and interpret existing ETL jobs in IBM Datastage, including SQL queries, transformation logic, and data flows.
- Create detailed, easy-to-understand technical documents that capture Datastage mappings, business logic, and transformation rules.
- Translate Datastage logic into conceptual frameworks that can be easily understood and implemented by Databricks (Spark) development teams.
- Collaborate with data engineers and business analysts to ensure accurate documentation and alignment with migration goals.
- Ensure the final documentation supports seamless pipeline implementation in Databricks, following best practices and performance guidelines.
Qualifications
-
Primary Skills:
- IBM Datastage (Advanced ETL Development and Analysis)
- Databricks / Apache Spark
- SQL (Strong proficiency in analyzing and rewriting complex queries)
- ETL Documentation & Data Mapping
- Data Pipeline Architecture Understanding
-
Secondary Skills:
- Cloud Platforms (Azure/AWS/GCP – experience with Databricks environments)
- Data Modeling & Business Logic Interpretation
- Agile / Scrum Methodology
- Excellent Communication & Technical Writing Skills
- Familiarity with Git / Version Control for document collaboration
Preferred Skills
No additional preferred skills specified.
Experience
Experience requirements are not specified; however, prior hands-on experience with IBM Datastage and Databricks is essential.
Environment
The position is specific to Work From Office (WFO) at ODC Chennai.
Salary
Salary details are not provided.
Growth Opportunities
Opportunities for growth within the company are not specified.
Benefits
Benefits information is not provided.