Big Data (GCP) Developer

Company Overview

(No company overview provided)

Job Summary

The Big Data (GCP) Developer will be responsible for designing and implementing data-driven solutions using Google Cloud Platform (GCP) and Big Query. This role involves utilizing strong programming skills to process and analyze large volumes of data, ensuring high performance and optimized database queries, while collaborating with various teams to meet project requirements.

Responsibilities

• Design and develop scalable data processing pipelines using Big Data technologies such as Spark, Hive, and MapReduce.
• Optimize database queries and indexing strategies to improve performance and efficiency in data retrieval.
• Collaborate with business stakeholders to gather requirements and perform Agile story analysis.
• Implement automated testing for data-driven applications to ensure reliability and quality.
• Develop scripts in UNIX/Shell/Perl/Python to support data processing activities.
• Work on web services design and implementation using REST/SOAP, with a focus on integration with Java applications.

Qualifications

• 6+ years of software development experience.
• 5 years of relevant experience in Big Data technologies and GCP.
• Strong programming skills in SQL and Pyspark for data processing.
• Hands-on expertise in application design and development, as well as automated testing.
• Proficient in UNIX/Shell/Perl/Python scripting.
• Experience with database query optimization and indexing techniques.
• Familiarity with web services design, specifically REST/SOAP, is a plus.
• Agile methodology experience is highly desirable.

Preferred Skills

• Experience in cloud-based environments, specifically with Google Cloud Platform (GCP).
• Knowledge of additional programming languages or frameworks.

Experience

• 6+ years of total software development experience with a minimum of 5 years in Big Data and GCP-related roles.

Environment

• (No specific work setting, location, or physical/environmental conditions provided)

Salary

(No salary information provided)

Growth Opportunities

(No growth opportunities provided)

Benefits

(No benefits information provided)