Data Engineer – Data Platform

Company Overview

(Not provided)

Job Summary

We are seeking a seasoned Lead Software Engineer to guide and mentor engineering teams while developing and maintaining a cutting-edge streaming data platform for a leading healthcare Customer Relationship Management (CRM) product. This role focuses on leading technical design, implementing scalable solutions using technologies such as Python, SQL, and Kafka, and ensuring high performance and quality across the platform.

Responsibilities

• Mentor and guide engineering teams in all aspects of the Software Development Life Cycle (SDLC).
• Lead technical design sessions and translate ideas into robust technical architecture.
• Develop and maintain scalable, high-performance data pipelines and streaming systems.
• Utilize Python, SQL, Scala, and NodeJS, while working with relational databases, NoSQL stores, and Kafka.
• Refactor and optimize legacy codebases for improved performance and scalability.
• Collaborate with product and engineering teams to deliver innovative solutions in an agile environment.
• Provide support to technical support teams with ad-hoc data queries and operational troubleshooting.
• Ensure data pipelines and Application Programming Interfaces (APIs) meet enterprise-grade performance and usability standards.

Qualifications

• Proven experience (9+ years) writing SQL queries for data analysis and reporting.
• 9+ years of hands-on experience developing with native Python; additional scripting languages are a plus.
• Strong understanding of software engineering concepts, programming methodologies, and the full SDLC.
• Experience leading teams or managing direct reports, with strong coaching and mentoring skills.
• Strong experience with Continuous Integration/Continuous Deployment (CI/CD) pipelines (Git, Jenkins).
• Hands-on experience with Docker, Kubernetes, and AWS or equivalent cloud platforms.
• Familiarity with Test-Driven Development (TDD), automated testing, and ensuring code quality.
• Understanding of large-scale distributed systems and enterprise scalability requirements.
• Excellent time management, prioritization, and agile delivery skills.

Preferred Skills

• Leadership and mentorship capabilities.
• Technical architecture design experience.
• Familiarity with Agile methodology.

Experience

• Minimum of 9 years of relevant experience in software engineering and data platform development.

Environment

• Work setting is full-time. Location details are not specified.

Salary

• Salary details are not specified.

Growth Opportunities

(Not provided)

Benefits

(Not provided)