Bigdata Admin

Company Overview

Not specified

Job Summary

We are seeking a Bigdata Admin skilled in managing and maintaining big data environments. This role focuses on Hadoop ecosystems, particularly with tools such as HDFS, Hive, and Spark. The successful candidate will contribute significantly to the effective management of data infrastructure, ensuring seamless operation and performance.

Responsibilities

• Manage and administer Hadoop clusters, ensuring optimal performance and availability.
• Configure and optimize HDFS, Hive, and Spark environments.
• Implement and manage AWS EMR clusters for data processing tasks.
• Collaborate with development teams to support applications using tools like Hue, HBase, and Sqoop.
• Automate deployment processes using Terraform, Jenkins, and GitHub.
• Ensure security protocols, including Kerberos configurations, are followed within the data environments.

Qualifications

• Extensive knowledge of Hadoop ecosystem components (HDFS, Hive, Spark).
• Proficient in Python and Linux scripting for automating tasks and managing environments.
• Solid understanding of AWS, particularly AWS EMR, to manage cloud-based data processing.
• Familiarity with DevOps practices and tools, including Terraform, Jenkins, and GitHub.
• Knowledge of data ingestion tools like Sqoop and data query capabilities using Phoenix.
• Strong analytical skills and problem-solving abilities.
• Excellent communication and collaboration skills.
• Bachelor’s degree in Computer Science, Information Technology, or a related field is preferred.

Preferred Skills

• Basic understanding of Kerberos for data security.
• Experience with Hue for interactive data visualization.
• Familiarity with Apache HBase for NoSQL database management.

Experience

• A minimum of [X] years of experience in Big Data administration, with a focus on Hadoop and AWS environments.
• Experience in deploying and managing applications within a big data framework.

Environment

The role may be conducted remotely, with potential opportunities for hybrid work arrangements. Candidates should be prepared to handle data environments both in cloud and on-premise settings.

Salary

Not specified

Growth Opportunities

Not specified

Benefits

Not specified