AWS Data Engineer

Company Overview

Information not provided.

Job Summary

The AWS Data Engineer will be responsible for designing and implementing data processing solutions using AWS and other cloud technologies. This role focuses on real-time data processing and will contribute to the organization’s data initiatives by enabling data accessibility and analytics capabilities at scale.

Responsibilities

• Design, develop, and maintain data pipelines and architectures for processing large datasets in real-time using Kafka and AWS.
• Implement and manage data integration processes with Kafka Streams, Kafka Connect, and Schema Registry.
• Collaborate with cross-functional teams to gather data requirements and ensure data quality and integrity.
• Utilize Azure Databricks for data processing and analytics, ensuring best practices are followed.
• Optimize data storage solutions using SQL and NoSQL databases while applying effective data modeling techniques.
• Lead and mentor team members in data engineering projects and contribute to stakeholder communication and project management.

Qualifications

• Experience: 4+ years in data engineering with a strong proficiency in Python and Kafka.
• Technical Skills:
  • Expertise in Kafka Streams, Kafka Connect, and Schema Registry for real-time data processing.
  • Strong knowledge of cloud platforms, with preference for Azure, and some experience with AWS or GCP.
  • Proficiency in SQL and NoSQL databases, with solid data modeling skills for big data applications.
  • Familiarity with containerization technologies such as Docker and Kubernetes as well as CI/CD pipelines.
• Soft Skills:
  • Strong analytical and problem-solving skills.
  • Excellent communication and stakeholder management abilities.

Preferred Skills

• Experience working with healthcare data (EHR, claims, HL7, FHIR, etc.) is a plus.
• Knowledge of Pyspark is good to have but not mandatory.

Experience

• Minimum of 8 years of experience as a data engineer, including specific experience with Python and Kafka.

Environment

• This role is fully remote, offering flexibility in work location.

Salary

Information not provided.

Growth Opportunities

Information not provided.

Benefits

Information not provided.