Senior Scala Big Data Engineer

Senior Scala Big Data Engineer

Job description

Would you like to wrangle Terabytes of data in minutes using cutting-edge technologies? Would you like to join a team of talented and passionate Software Engineers? Developing your programming skills, building and maintaining data lake, data platform and applications for one of the leading global retailers? Then we have some good news for you! We are looking for someone just like you. We want you in our team! We use a large scale on-prem cluster and we’re extending it now with a cutting edge, flexible, cloud-based approach. We cooperate with data scientists to optimise operations across a number of business areas (from van deliveries to in-store security).

Job requirements

What & How

  • Complex big data systems for one of the leading global retailers
  • Contributions to the open-source software communities
  • On premise and cloud-based infrastructure (Hortonworks Hadoop, Apache Spark, Apache Kafka, Kubernetes, Azure)
  • Professional and comprehensive monitoring, logging and alerting
  • Evolutionary Agile approach to software delivery
  • Great teamwork and knowledge sharing

What we expect

  • Able and eager to lead by example
  • Hands-on experience in designing and development of scalable, distributed, highly available solutions
  • Interest in solving challenging data engineering problems using state-of-the-art techniques
  • Grounded knowledge and understanding of data structures, algorithms and distributed computing
  • Fluent with Scala and/or other JVM languages and willingness to pick up new ones (eg python, bash)
  • Able to develop and maintain high-quality code
  • Can communicate with the business using good English (both written and verbal)
  • Experienced in using big data technology stacks (eg Hortonworks, Cloudera)
  • Has a deep understanding of data-intensive distributed systems

We do not expect you to qualify for all of the above points. A good understanding of some of these areas and a willingness to develop expertise in others may be sufficient. We are not concerned with your education or any other formalism. What we are concerned with are your passion, knowledge and experience.