Alchemy is currently partnering with a global technology firm who are looking to recruit a Big Data Engineer to be based onsite in Madrid, Spain.

Mandatory:

Experience in developing information ingestion systems in “on premise” environments based on Hadoop, either with the commercial distribution of Hortonworks (HDP and HDF) or Cloudera (CDP and CDF).
Within the technological stack of these distributions, it would be necessary to provide solid knowledge of HDFS, Apache Hive (>=3.1.0) and Apache Spark (>=2.3.x), as well as knowledge in the use of the flow automation tool Apache Niphi.
As programming languages, it is essential to have basic knowledge of Python, Scala and Java.
It is necessary to be familiar with CI/CD processes based on Azure DevOps, and the Apache Maven project construction tool.

Desirable:

Very valuable to have knowledge of Apache Kafka and Apache HBase.

Job Description