Hadoop Ops engineer

Job description
• Become a team member in a small & flexible team, backed by a leading international multi-billion-dollar global corporate, working with large scale data platforms, serving a variety of users and data sources
• Support and operate huge Hadoop clusters, while closely collaborating with the end-users
• Be the local representative of the Global Data Infrastructure team in Tel-Aviv
• Support highly available scalable solutions running in Production-grade environments
• Consult the local customers, supporting them and assisting with their research and batch processes
Primary Responsibilities
• Application/User On-boarding, HDFS space management, Queue Management, Workload Management, ACL implementation and Platform optimization.
• Setup, configuration and management of Hadoop clusters and security, using Kerberos and integration with LDAP.
• Scheduling MapReduce/hive/PIG/Kafka/Spark/Hbase jobs using Oozie and other schedulers like UC4 and Control-M.
• Perform Tuning and Increase Operational efficiency on a continuous basis.
• Work with cross-functional teams to set up production environment and enable solutions for business.
• Interact with business users to answer their queries and solve their problems.
• Able to help and Guide L1 support engineers to fix day-to-day Operational issues.
• Perform data migration, upgrades and database/tool maintenance etc.
• Preparing Technical Design Documents, Status Reports, issue logs and analysis documents etc.
• Formulate methods to enable consistent Data loading and optimize Batch loads.
• Prioritize tasks and deliverables, optimizing for a balanced delivery on short-term and long-term goals, champion engineering organization’s adoption and ongoing use of the data infrastructure
• Articulate and present findings and recommendations at different levels, with a clear bias towards impactful learning and results
Job Requirements
• 2-3 years’ Experience in Unix/Linux administration with large environments ( over 500 nodes) – Must
• Experience working with orchestration tools (Puppet, Ansible, Chef, Salt) – Significant Advantage
• Experience with shell scripting – Must
• Knowldge in Hadoop Support or Administration – Advantage
• Experience with the Java/Python programming language – Advantage
• B.Sc. in computer sciences/mathematics or equivalent experience – Must
• Strong communication skills (written and verbal) – Must
• Working experience in a global company – Significant advantage
• Independent, self-motivated and organized
• Highly motivated and Team player
• Agile, flexible, multi-tasking
• Service oriented