Big Data Engineer job description

Big Data Engineer Duties and Responsibilities

Big Data Engineer job description should contain a variety of functions and roles including:

Responsible for Hadoop development
Implementation including loading from disparate data sets, preprocessing using Hive and Pig.
Scope and deliver various Big Data solutions
Ability to design solutions independently based on high-level architecture.
Manage the technical communication between the survey vendor and internal systems
Maintain the production systems (Kafka, Hadoop, Cassandra, Elasticsearch)
Collaborate with other development and research teams
Building a cloud based platform that allows easy development of new applications

Big Data Engineer Requirements / Skills / Qualifications

Big Data Engineer job description should include these common skills and qualifications:

University degree in Computer Science, Engineering or equivalent preferred)
x years of experience as a Big Data Engineer or similar role
x years experience programming and/or architecting a back end language (Java, J2EE, Core
Experience with Java oriented technologies (JBoss, Spring, SpringMVC, Hibernate, REST/SOAP)
Experience with non-relational & relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, etc.)
Experience with Spark, or the Hadoop ecosystem and similar frameworks
Familiarity with various tools such as AWS, Mesos or Docker and an instinct for automation
Creative and innovative approach to problem-solving

As a hiring manager, recruiting an ideal Big Data Engineer starts with crafting a good job description. Use this Big Data Engineer job description template to save yourself time and help you attract the most qualified candidates. Feel free to revise it to meet your specific needs.

Job seekers interviewing for the role of a Big Data Engineer may also reference it in preparation for the interview.