Back to Job Search

Big Data Engineer

Job Description

Alchemy is currently partnering with a global technology firm who are looking to recruit a Big Data Engineer to be based onsite in Madrid, Spain.

Mandatory:
  • Experience in developing information ingestion systems in “on premise” environments based on Hadoop, either with the commercial distribution of Hortonworks (HDP and HDF) or Cloudera (CDP and CDF).
  • Within the technological stack of these distributions, it would be necessary to provide solid knowledge of HDFS, Apache Hive (>=3.1.0) and Apache Spark (>=2.3.x), as well as knowledge in the use of the flow automation tool Apache Niphi.
  • As programming languages, it is essential to have basic knowledge of Python, Scala and Java.
  • It is necessary to be familiar with CI/CD processes based on Azure DevOps, and the Apache Maven project construction tool.
Desirable:
  • Very valuable to have knowledge of Apache Kafka and Apache HBase.