Hadoop Admin with Linux and AWS

Company: Diverse Lynx
Location: Austin
Posted on: March 17, 2023

Job Description:

Job Description (Hadoop):

• 
  
• Installing Hadoop in Linux environment.
  
• Deployment in a Hadoop cluster and its maintenance.
  
• Health check of a Hadoop cluster monitoring whether it is up and running all the time.
  
• Resource management in a cluster environment. Host decommissioning and recommissioning.
  
• Configuring NameNode, ResourceManagr, Hbase to ensure its high availability
  
• Implementing and administering Hadoop infrastructure on an ongoing basis.
  
• Required hardware and software deployment in Hadoop environment. Furthermore to expanding of existing environments.
  
• User creation in Linux for Hadoop and its components in the ecosystem. Moreover, setting up Kerberos principals is a part of Hadoop administration.
  
• Performance tuning and running jobs in Hadoop clusters.
  
• Monitoring connectivity and security of Hadoop cluster - Kerberos
  
• Managing and reviewing log files in Hadoop.
  
• Management of HDFS file system and monitoring them.
  
• Communicating with other development, administrating and business teams. They include infrastructure, application, network, database, and business intelligence teams. Effective communication plays a key role in high quality and availability of data.
  
• Coordinating with application teams.
  
• Working as a key person for Vendor escalation
  
• Job Failure Troubleshooting
  
  
  Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

Keywords: Diverse Lynx, Austin , Hadoop Admin with Linux and AWS, Other , Austin, Texas