Data Engineer/Architect – Data Platform

Company Overview

Company details are not specified.

Job Summary

We are seeking a seasoned Lead/ Architect Software Engineer to guide and mentor engineering teams while developing and maintaining a cutting-edge streaming data platform for a leading healthcare CRM product. You will lead technical design, implement scalable solutions using Python, SQL, Kafka, and cloud technologies, and ensure high performance and quality across the platform.

Responsibilities

• Mentor and guide engineering teams in all aspects of the Software Development Life Cycle (SDLC).
• Lead technical design sessions and translate ideas into robust technical architecture.
• Develop and maintain scalable, high-performance data pipelines and streaming systems.
• Utilize Python, SQL, Scala, NodeJS, and work with relational databases, NoSQL stores, and Kafka.
• Refactor and optimize legacy codebases for improved performance and scalability.
• Collaborate with product and engineering teams to deliver innovative solutions in an agile environment.
• Support technical support teams with ad-hoc data queries and operational troubleshooting.
• Ensure data pipelines and APIs meet enterprise-grade performance and usability standards.

Qualifications

• Proven experience (9+ years) writing SQL queries for data analysis and reporting.
• 9+ years hands-on experience developing with native Python; additional scripting languages are a plus.
• Strong understanding of software engineering concepts, programming methodologies, and the full SDLC.
• Experience leading teams or managing direct reports, with coaching and mentoring skills.
• Strong experience with Continuous Integration/Continuous Deployment (CI/CD) pipelines (Git, Jenkins).
• Hands-on experience with Docker, Kubernetes, and AWS cloud platforms.
• Experience with Test-Driven Development (TDD), automated testing, and ensuring code quality.
• Understanding of large-scale distributed systems and enterprise scalability requirements.
• Excellent time management, prioritization, and agile delivery skills.

Experience

• Minimum of 8 years of relevant experience in software engineering and data engineering.

Environment

• Work Mode: 4 days from office
• Location: Bangalore.