Big Data Administrator
Antaes Asia Pte Ltd
Singapore, SG
5d ago
source : Glints

Job Description :

  • Contribute to IT projects in the banking industry for Antaes clients
  • Be a technical L2 resource for all Big Data services in the organization
  • Provide support for all production support activities within the Big Data team
  • Accountable for the overall health and stability of the technical solutions
  • Work with technical peers such as architects, peer experts and project teams on technology road maps and projects
  • Work with L3 / Service Manager to gain control over the scope of technical activities, develop best practices and gain knowledge over all aspects of support
  • Takes up technical tasks and also manages delegation for technical issues within the team
  • Animates the team to encourage collaboration and sharing of best practices
  • Supports new technologies and leverages them to provide consistency of service across streams
  • Proposes service improvements for all Big Data services supported throughout the organization
  • Documents, reviews, maintains and shares relevant technical information within the team
  • Provides technical knowledge, supports services both proactively and reactively to maintain the availability and reliability of system infrastructure in accordance to the SLA
  • Actively engages during any high severity issue and drives for issue resolution
  • Reviews technology changes to identify potential risks
  • Supports his / her team during diagnosis when technical issues rise in his / her scope of expertise
  • Facilitates transformation projects and suggest future directions for new areas of improvement and change
  • Guarantees the production readiness and license to operate of new projects and solutions
  • Actively engages to understand new technologies and technology trends and reviews them with a view to incorporating them into operations
  • Actively assists in identifying the most technical skilled candidates for open roles,
  • Technically coach and develop partner resources to improve quality and productivity
  • Contribute to the promotion of Antaes services on top of assistance provided to client
  • Job Requirements :

  • Minimum 6 years in a system administration role, performing system monitoring, storage capacity management, performance tuning and system infrastructure development
  • Minimum 1-2 years of experience in deploying and administering large Hadoop clusters
  • Must be comfortable working in rotating shifts (last shift ending at 2AM)
  • Must have skills in Linux Administration
  • Must have skills in Hadoop Administration (HDFS, YARN and other components)
  • Must have knowledge of Hortonworks Data Platform
  • Must have skills in Kafka Administration
  • Must have knowledge of Access control and security mechanisms like PAM and Kerberos
  • Must have experience in Hardware configurations and setup like racks, disk topology and RAID
  • Must have knowledge of Virtual Machines (deployment & configuration)
  • Must have knowledge of JVM
  • Candidates with development experience around any of the scripting languages like Java / Python / Perl / PHP / CSS / HTML would be given preference.
  • Experience with Spark development is an added advantage.
  • Working knowledge of Hadoop ecosystem (Hadoop, Hive, Pig, Oozie, Hbase, Flume, sqoop) using both automated toolsets as well as manual processes.
  • Ability to isolate and troubleshoot Hadoop service issues using a combination of system and Hadoop logs and monitoring / alerting systems.
  • Experience with Apache Ambari is a plus.

  • Preferred experience administering Hadoop 2.0 Clusters to include YARN and YARN-based applications such as Spark
  • Detailed knowledge of basic OS administration tasks such as configuring PAM authentication, disk quota, ulimit, etc. and managing security patches.
  • Experience coordinating rolling OS-level changes with cluster administration tools.
  • Experience configuring and using cluster-wide monitoring tools to diagnose cluster issues and propose operational enhancements.
  • Expertise in writing shell scripts, Perl / Python scripts and debugging existing scripts.
  • Ability to quickly learn new technologies and enable / train other analysts
  • Ability to work independently as well as in a team environment on moderate to highly complex issues
  • High technical aptitude and demonstrated progression of technical skills - continuous improvement
  • Ability to automate software / application installations and configurations hosted on Linux servers
  • Network and system administration experience, preferably in large-scale data center environments
  • High level of commitment, proactivity and good communication skills are expected
  • Strong analytical and problem-solving skills
  • Very good English proficiency
  • Report this job
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form