GCP Data Engineer

Company Overview

(No company overview provided.)

Job Summary

The GCP Data Engineer will primarily be responsible for developing, managing, and optimizing data processing solutions within Google Cloud Platform (GCP). The role focuses on leveraging robust data engineering practices to enhance data accessibility and quality, ultimately contributing to the organization's data-driven decision-making.

Responsibilities

• Design and implement data processing solutions using GCP DataProc and GCP BigQuery.
• Develop and maintain ETL (Extract, Transform, Load) pipelines involving large datasets.
• Write and optimize complex SQL queries and scripts in Python and PySpark.
• Collaborate with cross-functional teams to gather data requirements and ensure the data environment meets business needs.
• Perform data analysis to identify trends and insights that drive business value.
• Conduct data quality checks and regular performance tuning to enhance system performance.

Qualifications

• Minimum of 5-6 years of experience in data engineering.
• Strong expertise in GCP DataProc and GCP BigQuery.
• Proficient in Python and SQL.
• Solid experience with PySpark and data processing frameworks.
• Fluency in English is required, as teams operate internationally.
• Candidates must be in-house bench resources and available for immediate deployment.
• Candidates must pass Background Verification (BGV), including an employment check and Police Clearance Certificate (PCC) for criminal record checks.

Preferred Skills

• Familiarity with data modeling techniques and best practices.
• Experience in real-time data streaming technologies.
• Knowledge of machine learning concepts and frameworks can be a plus.

Experience

• 5+ years of relevant experience in data engineering roles, preferably with a focus on GCP technologies.

Environment

• This is a remote position, with working hours from 1:30 PM to 10:30 PM IST.
• Dual employment is not allowed; candidates must be committed to the client.

Salary

• Estimated budget of $700 per hour.

Growth Opportunities

(No specific growth opportunities provided.)

Benefits

(No benefits listed.)