Bigdata Admin

Company Overview

Not specified.

Job Summary

The Bigdata Admin is responsible for managing and maintaining big data solutions, specifically leveraging technologies such as Hadoop, HDFS, and various cloud platforms. This role entails ensuring optimal performance of data processing systems and supporting various data analytics projects within the organization.

Responsibilities

• Administer and manage Hadoop clusters, ensuring high availability and performance.
• Monitor and maintain HDFS, Hive, and other big data components for optimal functionality.
• Collaborate with teams to build Elastic MapReduce (EMR) clusters and manage Spark jobs.
• Implement security protocols, including Kerberos, to safeguard data and operations.
• Automate deployment processes using tools such as Terraform, Jenkins, and GitHub.
• Facilitate data integration using tools such as Sqoop, HBase, and Phoenix, providing necessary support for data retrieval and processing.
• Perform debugging and performance tuning of Hadoop jobs.

Qualifications

• 5+ years of experience with Hadoop technologies (Hive, PySpark, etc.).
• Strong programming experience in languages such as Python, Java, and Scala.
• Good SQL expertise.
• Experience of working on Azure Cloud (Azure SQL DB, ADLS Gen2, Azure Data Factory, etc.).
• Good communication skills.
• Ability to work independently in an Agile Software Development Life Cycle (SDLC) process.
• Educational qualifications in Computer Science or related fields (BTech, BSc, etc.) are preferred.

Preferred Skills

• Experience with Databricks.
• Familiarity with working with NoSQL databases.

Experience

• Minimum of 3-5 years of experience in big data administration and related technologies.
• Proven experience in managing Hadoop and cloud-based services.

Environment

Not specified.

Salary

Not specified.

Growth Opportunities

Not specified.

Benefits

Not specified.