Hadoop Developer

  • Company:
  • Location:
  • Salary:
    negotiable / month
  • Job type:
  • Posted:
    10 hours ago
  • Category:

Responsibilities Actual project development experience 2+ years on the required skills Actual project experience in hadoop, spark, hive, Oozie, nosql, Core java (OOPS), shell scripting Should be familiar with CI/CD tools like Bitbucket, GIT, Jenkins, etc should have good understanding of Hadoop MapReduce framework – in order to tackle production issues, development/patches to existing application, customizing jobs to handle memory issues, cluster utilization, etc should be familiar with any one RDBMS (Oracle, MySQL) Work experience on NOSQL(specifically HBase)is an added advantage work experience in Banking domain is an added advantage Hadoop and Spark : ask questions on MR framework, YARN, Spark framework, differences, areas where we can customize the framework as per the requirements hive: analytical/window functions, UDFs, customizing a individual hive job Oozie: forks/joins, workflow.xml, how to can add/alter properties in workflow, different types of logs (syslog, YARN logs – for finding out exact issue) Core java : OOPS concepts, complex data types like maps, etc HBase : architecture, components, working shell scripting : test the working level in shell scripting (should be at least 60% proficient)